-- Logs begin at Mon 2021-11-15 17:07:42 UTC, end at Mon 2021-11-15 18:05:30 UTC. -- Nov 15 17:39:43.631229 dv-cinder-788366-7-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 15 17:39:46.375816 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.common.config [-] Logging enabled! Nov 15 17:39:46.376449 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 15 17:39:46.376566 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108034) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 15 17:39:46.379965 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.common.config [-] Logging enabled! Nov 15 17:39:46.380217 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 15 17:39:46.380534 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108034) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 15 17:39:46.381459 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 17:39:46.381689 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 17:39:46.382054 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 17:39:46.382295 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 17:39:46.382521 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 17:39:46.382836 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.383328 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 15 17:39:46.383646 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.383961 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.384234 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.384543 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.384814 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.385089 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.385392 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.385776 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.386047 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.386327 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.386645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.386935 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.387214 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] config_source = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.387498 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.387864 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.388176 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] debug = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.388461 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.388950 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.389360 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.389635 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.389920 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.390196 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.390473 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.390748 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.391004 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.391337 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] host = dv-cinder-788366-7-iscsi {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.391610 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.391914 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.392201 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.392485 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.392758 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.393027 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.393302 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.393573 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_dir = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.393842 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.394114 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.394381 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.394664 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.394950 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.395171 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.395389 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.395680 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.395987 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.396263 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.396533 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.396803 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.397073 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.397342 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.397606 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.397886 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.398166 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.398448 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.398717 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.399021 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.399288 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.399553 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.399858 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.400131 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.400406 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.400677 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.400960 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.401224 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.401489 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.401784 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.402065 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.402345 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.402626 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.402895 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.403174 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.403440 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.403729 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_journal = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.403999 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_json = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.404271 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.404537 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.404813 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.405080 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.405345 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.405613 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.405875 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.406153 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:46.406445 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.406738 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.407033 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.407310 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.407607 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.407913 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.408198 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.408469 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.408751 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.409032 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.409316 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.409589 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.409872 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.410143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.410437 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.410736 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.411023 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.411307 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.411577 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.411879 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.412151 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.412421 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.412701 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.412973 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.413254 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.413538 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.413811 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.414093 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.414381 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.414755 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.415034 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.415300 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.415584 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.415894 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.416164 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.416437 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.416722 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.416995 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.417262 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.417537 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.417808 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.418075 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.418343 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.418614 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.418904 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.419178 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.419445 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.419731 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.420010 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.420276 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.420563 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.420836 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.421106 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.421373 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.421645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.421913 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.422182 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.422451 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.422717 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.422991 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.423261 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.423528 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.423895 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.424169 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.424439 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.424708 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.424975 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.425246 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.425510 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.425776 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.426044 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.426311 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.426578 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.426860 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.427152 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.427422 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.427721 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.427989 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.428265 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.428536 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.428807 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.429078 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.429350 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.429616 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.429898 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.430308 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.430734 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.431021 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.431297 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.431615 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.431915 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.432198 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.432471 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.432747 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.433025 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.433303 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.433592 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.433877 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.434163 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.434449 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.434735 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.435010 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.435312 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.435584 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:46.435827 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 17:39:46.436067 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=108034) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 15 17:39:46.866480 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=108034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 17:39:46.866820 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=108034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 17:39:46.867035 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=108034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 17:39:46.867369 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 15 17:39:47.188073 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.188304 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.188606 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.189803 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.190093 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.190472 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.223999 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.224275 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.224545 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.241231 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.241495 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.241764 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.270129 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.270414 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.270681 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.306272 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.306524 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.306810 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.540030 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.540740 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.540740 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.540891 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.541499 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.666933 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.667260 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.667538 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.667832 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.668097 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.668405 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.668661 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.668915 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.669164 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.669447 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.669702 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.669950 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.670203 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.670451 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.670701 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.670965 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.671223 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.671468 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.671759 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.672018 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.672287 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.672542 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.672826 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.673208 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.673459 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.673704 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.674100 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.674374 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.674615 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.674848 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.675082 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.675313 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:47.675683 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 15 17:39:47.679014 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 15 17:39:47.683393 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 15 17:39:47.687472 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(400, 449)])]) Nov 15 17:39:47.689124 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 15 17:39:47.689594 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 15 17:39:47.689931 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 15 17:39:47.690312 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 15 17:39:47.693163 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 15 17:39:47.693412 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 15 17:39:47.693760 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 15 17:39:47.699115 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 15 17:39:47.721698 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 15 17:39:47.722143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.722443 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=108034) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:89}} Nov 15 17:39:47.722798 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.724203 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=108034) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 15 17:39:47.724481 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 15 17:39:47.724725 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 15 17:39:47.728101 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.728384 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:47.792694 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 15 17:39:47.792844 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 15 17:39:47.793084 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 15 17:39:47.793456 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 15 17:39:47.815380 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_db.sqlalchemy.engines [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 17:39:48.361114 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing driver for type 'gre' Nov 15 17:39:48.361757 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] gre ID ranges: [(1, 1000)] Nov 15 17:39:48.416975 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing driver for type 'local' Nov 15 17:39:48.417331 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing driver for type 'vlan' Nov 15 17:39:48.431137 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] VlanTypeDriver initialization complete Nov 15 17:39:48.431468 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing driver for type 'vxlan' Nov 15 17:39:48.432019 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] vxlan ID ranges: [(1, 1000)] Nov 15 17:39:48.485269 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing extension driver 'port_security' Nov 15 17:39:48.485682 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.extensions.port_security [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] PortSecurityExtensionDriver initialization complete Nov 15 17:39:48.486012 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing mechanism driver 'openvswitch' Nov 15 17:39:48.486341 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing mechanism driver 'hyperv' Nov 15 17:39:48.493049 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.plugin [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=108034) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:39:48.493878 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.494239 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.494583 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.495478 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.495934 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.496281 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.496617 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.497004 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.497398 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.497741 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.498076 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.498456 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.498851 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.499196 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.499526 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.499940 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.500377 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.500672 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.501195 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.501564 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.501965 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > address_group after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.502304 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > address_group after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.502635 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > address_group after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.503019 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=108034) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 17:39:48.503380 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] ML2 OVO RPC backend initialized. {{(pid=108034) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 15 17:39:48.504100 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.504446 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.504846 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.505189 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > networks before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.505536 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.505865 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > ports before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.506198 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.506529 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnets before_response 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.506860 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.507187 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.507512 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.507865 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.508247 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.508575 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.509082 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.509413 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.509738 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > subnet after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.510299 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.plugin [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Modular L2 Plugin initialization complete Nov 15 17:39:48.510627 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading services supported by the core plugin {{(pid=108034) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 15 17:39:48.510946 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.plugins.ml2.managers [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Got port-security extension from driver 'port_security' Nov 15 17:39:48.511399 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.extensions.vlantransparent [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Disabled vlantransparent extension. Nov 15 17:39:48.511903 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=108034) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 15 17:39:48.512210 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: router Nov 15 17:39:48.549119 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.549705 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_create 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.549818 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router before_create 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.550201 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.550567 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.550909 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_delete 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.551263 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > floatingip after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.551743 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > floatingip after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.552089 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_create 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.552433 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.552800 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.553108 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.553435 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.553863 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.554231 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.554552 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.554890 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: subnet after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.555241 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.555779 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > port precommit_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.556130 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_create 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.556471 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.556807 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.557158 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router after_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.557493 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_delete 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.557832 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_create 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.558186 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router_interface after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.558521 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_update 55549900 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.558874 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > agent after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.559213 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > agent after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.559532 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > network after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.560406 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Tracking information for resource: router configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:48.560735 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Tracking information for resource: floatingip configured {{(pid=108034) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 17:39:48.565632 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.db.l3_agentschedulers_db [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 15 17:39:48.566235 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.566579 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.566923 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.567265 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: port after_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.568061 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router before_create 55550100 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.568419 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_delete 55550100 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.568773 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_create 55550100 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.569119 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > router precommit_update 55550100 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.574031 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.provider_configuration [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service providers = [] {{(pid=108034) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 15 17:39:48.574387 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.db.servicetype_db [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=108034) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 15 17:39:48.577311 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.service_base [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=108034) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 17:39:48.577686 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.service_base [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=108034) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 17:39:48.578014 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.service_base [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=108034) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 17:39:48.578853 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.services.service_base [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=108034) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 17:39:48.579242 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.services.service_base [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 15 17:39:48.579606 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.579942 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 15 17:39:48.590518 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded METERING plugin. Description: METERING {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.590849 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: auto_allocate Nov 15 17:39:48.596613 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: network precommit_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.596967 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: network precommit_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.597464 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.597772 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: tag Nov 15 17:39:48.604670 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.604996 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: timestamp Nov 15 17:39:48.608798 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.609117 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: network_ip_availability Nov 15 17:39:48.614644 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.614940 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.615286 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.616011 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.616314 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: flavors Nov 15 17:39:48.621760 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.622087 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading Plugin: revisions Nov 15 17:39:48.626388 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=108034) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 17:39:48.626779 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.760s {{(pid=108034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 17:39:48.627511 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=108034) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 15 17:39:48.627873 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Initializing extension manager. Nov 15 17:39:48.628380 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: __init__.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.628717 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: __pycache__ {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.629040 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.629361 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: address_group.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.630106 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.630655 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: address-group Nov 15 17:39:48.630973 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: address_scope.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.631676 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.632214 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: address-scope Nov 15 17:39:48.632530 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: admin_state_down_before_update.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.633507 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.634006 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: router-admin-state-down-before-update Nov 15 17:39:48.634323 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: agent.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.635015 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.635504 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: agent Nov 15 17:39:48.635849 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: agent_resources_synced.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.636747 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.637244 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: agent-resources-synced Nov 15 17:39:48.637554 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: allowedaddresspairs.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.639324 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.639870 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: allowed-address-pairs Nov 15 17:39:48.640188 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: auto_allocated_topology.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.641254 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.641771 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: auto-allocated-topology Nov 15 17:39:48.642088 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: availability_zone.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.642768 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.643256 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: availability_zone Nov 15 17:39:48.643568 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: availability_zone_filter.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.644504 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.644990 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: availability_zone_filter Nov 15 17:39:48.645301 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: data_plane_status.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.646194 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.646685 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension data-plane-status not supported by any of loaded plugins Nov 15 17:39:48.646993 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: default_subnetpools.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.647927 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.648425 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: default-subnetpools Nov 15 17:39:48.648734 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: dhcpagentscheduler.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.649564 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.650062 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: dhcp_agent_scheduler Nov 15 17:39:48.650371 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: dns.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.651274 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.651798 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension dns-integration not supported by any of loaded plugins Nov 15 17:39:48.652103 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: dns_domain_ports.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.653007 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.653503 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 15 17:39:48.653812 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.654736 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.655224 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 15 17:39:48.655535 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: dvr.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.656236 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.656726 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: dvr Nov 15 17:39:48.657041 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: ecmp_routes.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.657952 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.658458 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension ecmp_routes not supported by any of loaded plugins Nov 15 17:39:48.658761 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: empty_string_filtering.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.659654 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.660177 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: empty-string-filtering Nov 15 17:39:48.660789 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.661374 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.661872 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 15 17:39:48.662182 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.663076 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.663566 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 15 17:39:48.663914 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: external_net.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.664952 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.665447 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: external-net Nov 15 17:39:48.665756 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: extra_dhcp_opt.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.666653 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.667144 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: extra_dhcp_opt Nov 15 17:39:48.667457 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: extraroute.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.668375 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.668877 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: extraroute Nov 15 17:39:48.669185 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: extraroute_atomic.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.670215 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.670923 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: extraroute-atomic Nov 15 17:39:48.671237 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: filter_validation.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.671922 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.672415 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: filter-validation Nov 15 17:39:48.672727 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: fip_pf_description.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.673624 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.674114 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 15 17:39:48.674424 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: fip_port_details.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.675317 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.675836 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: fip-port-details Nov 15 17:39:48.676152 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: flavors.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.677390 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.677905 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: flavors Nov 15 17:39:48.678220 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.679964 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.680511 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 15 17:39:48.680834 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: floatingip_pools.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.681533 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.682038 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: floatingip-pools Nov 15 17:39:48.682355 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: ip_allocation.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.683270 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.683792 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension ip_allocation not supported by any of loaded plugins Nov 15 17:39:48.684116 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: ip_substring_port_filtering.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.685015 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.685515 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: ip-substring-filtering Nov 15 17:39:48.685835 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l2_adjacency.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.686736 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.687232 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension l2_adjacency not supported by any of loaded plugins Nov 15 17:39:48.687553 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.688579 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.689083 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: router Nov 15 17:39:48.689395 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3_conntrack_helper.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.691632 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.692171 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 15 17:39:48.692491 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3_ext_gw_mode.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.693410 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.693911 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: ext-gw-mode Nov 15 17:39:48.694232 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3_ext_ha_mode.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.695156 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.695675 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: l3-ha Nov 15 17:39:48.696030 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3_flavors.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.696937 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.697439 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: l3-flavors Nov 15 17:39:48.697749 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.698649 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.699143 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: l3-port-ip-change-not-allowed Nov 15 17:39:48.699452 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: l3agentscheduler.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.700530 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.701033 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: l3_agent_scheduler Nov 15 17:39:48.701350 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: logging.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.702856 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.703372 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension logging not supported by any of loaded plugins Nov 15 17:39:48.703689 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: metering.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.704460 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.705025 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: metering Nov 15 17:39:48.705345 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.706555 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.707056 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: metering_source_and_destination_fields Nov 15 17:39:48.707377 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: multiprovidernet.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.708331 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.708839 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: multi-provider Nov 15 17:39:48.709143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: netmtu.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.710049 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.710540 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: net-mtu Nov 15 17:39:48.710854 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: netmtu_writable.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.711791 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.712298 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: net-mtu-writable Nov 15 17:39:48.712609 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: network_availability_zone.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.713275 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.713764 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: network_availability_zone Nov 15 17:39:48.714076 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: network_ip_availability.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.715195 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.715722 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: network-ip-availability Nov 15 17:39:48.716033 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: network_segment_range.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.716786 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.717279 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension network-segment-range not supported by any of loaded plugins Nov 15 17:39:48.717596 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: pagination.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.718574 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.718895 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: pagination Nov 15 17:39:48.719206 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: port_device_profile.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.720155 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.720652 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: port-device-profile Nov 15 17:39:48.720966 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: port_mac_address_regenerate.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.721876 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.722372 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: port-mac-address-regenerate Nov 15 17:39:48.722682 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: port_numa_affinity_policy.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.723574 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.724106 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: port-numa-affinity-policy Nov 15 17:39:48.724417 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: port_resource_request.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.725326 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.725822 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension port-resource-request not supported by any of loaded plugins Nov 15 17:39:48.726133 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: port_resource_request_groups.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.727171 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.727782 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 15 17:39:48.728101 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: portbindings.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.729022 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.729522 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: binding Nov 15 17:39:48.729840 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: portbindings_extended.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.731113 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.731616 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: binding-extended Nov 15 17:39:48.731961 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: portsecurity.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.732865 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.733363 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: port-security Nov 15 17:39:48.733677 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: project_id.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.734645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.734964 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: project-id Nov 15 17:39:48.735341 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: providernet.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.736314 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.736814 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: provider Nov 15 17:39:48.737124 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.740665 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.741176 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos not supported by any of loaded plugins Nov 15 17:39:48.741499 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_bw_limit_direction.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.742857 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.743445 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 15 17:39:48.743805 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.744710 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.745595 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 15 17:39:48.745913 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_default.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.746806 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.747298 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-default not supported by any of loaded plugins Nov 15 17:39:48.747619 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_fip.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.748292 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.748781 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-fip not supported by any of loaded plugins Nov 15 17:39:48.749094 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_gateway_ip.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.749994 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.750488 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 15 17:39:48.750798 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_port_network_policy.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.751720 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.752213 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 15 17:39:48.752528 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.753564 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.754066 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 15 17:39:48.754382 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_pps_rule.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.755550 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.756255 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-pps not supported by any of loaded plugins Nov 15 17:39:48.756576 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_rule_type_details.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.757493 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.758005 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 15 17:39:48.758444 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: qos_rules_alias.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.759486 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.760094 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 15 17:39:48.760414 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: quota_check_limit.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.761315 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.761816 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: quota-check-limit Nov 15 17:39:48.762132 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: quotasv2.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.763050 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.763369 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: quotas Nov 15 17:39:48.763680 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: quotasv2_detail.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.766833 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.767167 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: quota_details Nov 15 17:39:48.767525 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: rbac.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.768605 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.769117 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: rbac-policies Nov 15 17:39:48.769435 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: rbac_address_group.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.770353 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.770854 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: rbac-address-group Nov 15 17:39:48.771174 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: rbac_address_scope.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.772105 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.772607 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: rbac-address-scope Nov 15 17:39:48.772926 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: rbac_security_groups.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.773850 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.774348 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: rbac-security-groups Nov 15 17:39:48.774658 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: rbac_subnetpool.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.775567 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.776101 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: rbac-subnetpool Nov 15 17:39:48.776414 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: revisionifmatch.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.777316 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.777824 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: revision-if-match Nov 15 17:39:48.778135 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: revisions.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.779228 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.779718 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: standard-attr-revisions Nov 15 17:39:48.780060 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: router_availability_zone.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.780721 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.781221 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: router_availability_zone Nov 15 17:39:48.781533 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: routerservicetype.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.782432 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.782923 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension router-service-type not supported by any of loaded plugins Nov 15 17:39:48.783233 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.784151 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.784652 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: security-groups-normalized-cidr Nov 15 17:39:48.784969 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: security_groups_port_filtering.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.785945 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.786449 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: port-security-groups-filtering Nov 15 17:39:48.786762 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: security_groups_remote_address_group.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.787681 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.788199 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: security-groups-remote-address-group Nov 15 17:39:48.788516 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: security_groups_shared_filtering.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.789523 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.790070 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: security-groups-shared-filtering Nov 15 17:39:48.790384 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.790975 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 15 17:39:48.791288 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: securitygroup.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.800960 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.801525 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: security-group Nov 15 17:39:48.801861 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: segment.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.802645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.803169 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension segment not supported by any of loaded plugins Nov 15 17:39:48.803487 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.804448 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.804946 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 15 17:39:48.805280 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: servicetype.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.806419 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.807056 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: service-type Nov 15 17:39:48.807375 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: sorting.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.808391 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.808717 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: sorting Nov 15 17:39:48.809030 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: standard_attr_segment.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.809937 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.810436 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 15 17:39:48.810752 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: standardattrdescription.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.811404 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.811923 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: standard-attr-description Nov 15 17:39:48.812236 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: stateful_security_group.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.813148 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.813650 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: stateful-security-group Nov 15 17:39:48.813969 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: stdattrs_common.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.814535 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 15 17:39:48.814845 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.815779 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.816281 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 15 17:39:48.816595 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnet_onboard.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.817672 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.818180 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: subnet_onboard Nov 15 17:39:48.818498 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnet_segmentid_writable.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.819412 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.819936 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 15 17:39:48.820252 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnet_service_types.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.821352 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.821859 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: subnet-service-types Nov 15 17:39:48.822175 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnetallocation.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.823244 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.823780 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: subnet_allocation Nov 15 17:39:48.824102 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.824766 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.825280 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: subnetpool-prefix-ops Nov 15 17:39:48.825595 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.826511 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.827008 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 15 17:39:48.827322 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: tagging.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.828402 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.828906 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: standard-attr-tag Nov 15 17:39:48.829224 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: timestamp.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.830414 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.830914 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loaded extension: standard-attr-timestamp Nov 15 17:39:48.831231 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: trunk.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.832278 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.832785 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension trunk not supported by any of loaded plugins Nov 15 17:39:48.833096 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: trunk_details.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.834001 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.834501 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension trunk-details not supported by any of loaded plugins Nov 15 17:39:48.834814 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: uplink_status_propagation.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.835746 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.836255 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 15 17:39:48.836612 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Loading extension file: vlantransparent.py {{(pid=108034) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 17:39:48.837274 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=108034) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 17:39:48.837753 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extension vlan-transparent not supported by any of loaded plugins Nov 15 17:39:48.840339 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:network Nov 15 17:39:48.840878 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnet Nov 15 17:39:48.841268 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 17:39:48.841657 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:port Nov 15 17:39:48.844156 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.844596 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service FLAVORS assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.845226 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.845657 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.845978 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:router Nov 15 17:39:48.846419 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:floatingip Nov 15 17:39:48.846885 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service METERING assigned prefix: /metering {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.848388 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.848749 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.849092 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108034) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:39:48.850084 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of CountableResource for resource:rbac_policy Nov 15 17:39:48.850518 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:security_group Nov 15 17:39:48.850951 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 15 17:39:48.851534 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service CORE assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.851887 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 17:39:48.852278 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] subnetpool is already registered Nov 15 17:39:48.852706 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service CORE assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.853025 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 17:39:48.853351 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] subnetpool is already registered Nov 15 17:39:48.855647 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.856128 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service FLAVORS assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.856710 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.857125 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.857451 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:router Nov 15 17:39:48.857788 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] router is already registered Nov 15 17:39:48.858210 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:floatingip Nov 15 17:39:48.858540 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] floatingip is already registered Nov 15 17:39:48.858986 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service METERING assigned prefix: /metering {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.859629 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of CountableResource for resource:rbac_policy Nov 15 17:39:48.859968 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] rbac_policy is already registered Nov 15 17:39:48.860372 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:security_group Nov 15 17:39:48.860693 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] security_group is already registered Nov 15 17:39:48.861085 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 15 17:39:48.861411 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] security_group_rule is already registered Nov 15 17:39:48.862018 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service CORE assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.862334 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 17:39:48.862660 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] subnetpool is already registered Nov 15 17:39:48.863070 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.v2.resource_helper [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Service CORE assigned prefix: {{(pid=108034) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 17:39:48.863383 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 17:39:48.863724 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING neutron.quota.resource_registry [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] subnetpool is already registered Nov 15 17:39:48.864199 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: extensions {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.865730 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: address-groups {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.867188 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: address-scopes {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.868731 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: agents {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.869872 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: auto-allocated-topology {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.871466 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: availability_zones {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.872731 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: dhcp-networks {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.874223 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: dhcp-agents {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.875644 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: routers {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.877880 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: flavors {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.879050 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: service_profiles {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.880269 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: next_providers {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.881736 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: service_profiles {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.883334 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: floatingip-pools {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.884578 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: routers {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.886751 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: floatingips {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.888132 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: l3-routers {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.889522 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: l3-agents {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.890923 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: metering-labels {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.892297 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: metering-label-rules {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.893576 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: network-ip-availabilities {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.894839 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: bindings {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.896520 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: quotas {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.898066 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: quotas {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.899656 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: rbac-policies {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.900992 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: security-groups {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.902215 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: security-group-rules {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.903423 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: service-providers {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.904657 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: subnetpools {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.906057 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: subnetpools {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.907507 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.909241 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.911960 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.913719 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.915604 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.917475 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.919140 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.921053 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.922823 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.924671 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron.api.extensions [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Extended resource: tags {{(pid=108034) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 17:39:48.930759 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING keystonemiddleware.auth_token [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 17:39:48.935482 dv-cinder-788366-7-iscsi neutron-server[108034]: WARNING keystonemiddleware.auth_token [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 17:39:48.944238 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Acquired lock "singleton_lock" {{(pid=108034) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 15 17:39:48.944702 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_concurrency.lockutils [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Releasing lock "singleton_lock" {{(pid=108034) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 15 17:39:48.945342 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Starting 2 workers Nov 15 17:39:48.950098 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Started child 108141 {{(pid=108034) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 17:39:48.954433 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Started child 108142 {{(pid=108034) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 17:39:48.955455 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.956151 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO neutron.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Neutron service started, listening on 0.0.0.0:9696 Nov 15 17:39:48.956479 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Publish callbacks [] for process, before_spawn {{(pid=108034) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.956924 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [-] (108141) wsgi starting up on http://0.0.0.0:9696 Nov 15 17:39:48.958874 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Starting 1 workers Nov 15 17:39:48.959364 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.960597 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [-] (108142) wsgi starting up on http://0.0.0.0:9696 Nov 15 17:39:48.964109 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Started child 108143 {{(pid=108034) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 17:39:48.964638 dv-cinder-788366-7-iscsi neutron-server[108034]: INFO oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Starting 1 workers Nov 15 17:39:48.967790 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] calling RpcWorker wait() {{(pid=108143) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 15 17:39:48.968349 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] returning from RpcWorker wait() {{(pid=108143) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 15 17:39:48.969092 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Started child 108144 {{(pid=108034) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 17:39:48.969476 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.969843 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG neutron_lib.callbacks.manager [None req-28a7e1fb-14b8-4660-8f9f-ff2290fb0b7b None None] Publish callbacks [] for process, after_spawn {{(pid=108034) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.969971 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:39:48.971719 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108034) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 15 17:39:48.971921 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 17:39:48.972081 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 17:39:48.972309 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 17:39:48.972645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 17:39:48.972771 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 17:39:48.973304 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.973582 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.973847 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.974089 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.974391 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.974954 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.975201 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.975416 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.975570 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:39:48.976143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.976143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.976143 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.976493 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.976493 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.976760 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.977091 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.977275 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:39:48.977404 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.977630 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.977913 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.978105 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.978274 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.978561 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.978739 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.979014 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] debug = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.979261 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.979691 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.979952 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.980192 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.980532 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.980672 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.980897 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.981165 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.981369 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.981589 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.981828 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.982079 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.982311 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.982532 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.982769 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.982974 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.983208 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.983418 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.983883 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] host = dv-cinder-788366-7-iscsi {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.984097 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.984324 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.984559 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.984793 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.985025 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.985259 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.985502 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.985743 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.985985 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.986217 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.986459 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.986702 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.986912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.987161 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.987352 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_options = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.987530 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.987827 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.988079 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.988266 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.988427 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.988595 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.988842 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.989021 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.989259 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.989468 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.989676 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.989897 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.990107 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.990333 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.990646 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.990811 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.991057 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.991283 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.991529 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.991794 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.992020 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.992252 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.992574 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.992728 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.992956 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.993163 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.993437 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.993637 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.993848 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.994094 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.994323 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.994571 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.994782 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.995364 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.995621 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.995867 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.996087 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.996293 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.996557 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.996774 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.997017 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.997256 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.997468 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.997706 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.997927 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.998159 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.998432 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_json = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.998592 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.998818 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.999053 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.999269 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.999477 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.999684 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:48.999916 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.000142 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.000648 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.000960 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.001499 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.002496 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.002496 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.002790 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.003001 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.003204 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.003580 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.003839 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.004072 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.004311 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.004629 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.004821 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.005061 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.005410 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.005783 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.006052 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.006295 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.006528 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.006756 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.006992 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.007257 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.007650 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.007831 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.007956 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.008220 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.008555 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.008815 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.009051 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.31/identity {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.009861 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.009861 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.009861 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.010222 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.010222 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.010461 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.010584 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.010807 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.011023 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.011227 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.011469 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.011740 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.011954 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.012177 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.012456 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.012648 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.013036 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.013391 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.013813 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.014158 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.014549 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.014731 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.015151 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.015345 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.015769 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.016152 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.016563 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.016742 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.017141 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.017337 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.017592 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.017853 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.018107 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.018275 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.018643 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.019031 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.019287 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.019503 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.019726 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.019941 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.020155 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.020396 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.020605 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.020856 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.021069 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.021283 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.021498 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.021706 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.021912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.022135 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.022329 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.022536 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.022743 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.022939 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.023351 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.023538 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.023971 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.024359 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.024585 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.025047 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.025340 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.025752 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.026287 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.026513 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.026756 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.026990 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.027236 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.027451 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.029176 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.029432 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.030556 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.030793 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.032573 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.034034 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.034306 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.034586 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.034837 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.035071 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.035782 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.036013 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.038607 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.040256 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.040559 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.040820 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.041068 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.041360 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.042837 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.043112 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.043399 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.043621 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.043965 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.044265 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.044576 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.044860 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.045127 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.045384 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.045645 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.045933 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.046187 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.046441 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.046698 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.046938 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.047220 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.047478 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.047744 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.047963 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.048195 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.048489 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.048725 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.049923 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.050151 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.050409 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.052624 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.052893 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.053178 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.053440 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.053703 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.053961 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.054201 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.31/identity {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.054464 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.055597 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.056010 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.057172 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.057438 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.057667 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.057912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.058133 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.058372 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.058628 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.059208 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.059446 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.059666 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.059915 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.060142 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.061591 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.061978 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.062493 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.062672 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.062918 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.063167 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.063398 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.063619 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.063902 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.064128 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.064742 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.065141 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.068114 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.068392 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.068657 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.068941 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.069171 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.069438 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.069677 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.069902 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.070127 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.070366 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.070589 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.070836 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.071074 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.071307 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.071607 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.071917 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.072218 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.072468 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.072704 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.072956 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.073172 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.073427 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.073664 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.073887 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.074127 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.074345 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.074562 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.074807 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.076005 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.077161 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.077408 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.077653 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.077906 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.078153 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.078386 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.079284 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.079555 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.079826 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.080096 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.080350 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.080573 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.080807 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.081028 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.081248 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.081496 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.081713 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.082123 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.082778 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.083217 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.083441 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.083670 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.083947 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.084163 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.084431 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.084646 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.084863 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.085089 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.085310 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.085546 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.085772 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.085983 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.086193 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.086623 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.086845 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.087055 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.087303 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.087512 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.087739 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.087963 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.088186 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.088398 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.088707 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.089259 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.089495 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.089780 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.090032 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.090288 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.090528 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.090853 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.091084 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.091326 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.091545 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.091791 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.092016 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.092273 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.092575 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.092870 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.093139 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.093382 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.093651 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.093929 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.094173 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.094391 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.094676 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.094996 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.095284 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.095552 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.095809 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.096050 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:39:49.096144 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.096273 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.096516 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.096752 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.096984 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.097199 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.097456 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.097687 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.097934 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.098157 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.098384 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.098626 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.098852 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.099083 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.099321 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.099534 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.099735 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 17:39:49.100235 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108034) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 15 17:39:49.100398 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 17:39:49.100553 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 17:39:49.100709 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 17:39:49.100876 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 17:39:49.101016 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 17:39:49.101224 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.101377 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.101531 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.101690 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.101905 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102153 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102383 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102524 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102659 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102793 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.102928 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103061 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103195 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103344 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103501 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103637 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103811 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.103946 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104107 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104248 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104408 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104546 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104707 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] debug = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.104857 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105071 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105249 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105386 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105518 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105651 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105808 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.105965 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.106123 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.106269 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.106423 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.106638 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.106809 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.107550 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.107847 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.108003 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.108759 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.108922 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.109276 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] host = dv-cinder-788366-7-iscsi {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.109616 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.109848 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.110080 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.110251 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.110486 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.110724 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.110885 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.111046 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.111202 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.111501 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.111821 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.112112 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.112413 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.112573 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.112737 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_options = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.112878 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.113015 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.113166 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.113343 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.113503 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.113836 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.114159 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.114480 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.114804 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.115123 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.115452 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.115605 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.115974 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.116295 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.116454 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.116748 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117047 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117205 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117368 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117611 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117772 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.117931 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.118119 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.118390 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.118548 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.118710 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.118871 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.119058 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.119178 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.119525 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.119866 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.120567 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.120793 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.120953 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121109 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121264 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121424 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121580 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121757 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.121887 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122043 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122213 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122359 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122516 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122682 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122825 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.122979 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_json = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123135 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123291 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123446 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123603 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123778 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.123935 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.124091 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.124248 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 17:39:49.124425 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.124588 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.124760 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.124920 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125081 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125242 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125402 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125562 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125722 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.125881 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126052 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126215 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126386 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126546 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126710 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.126873 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127034 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127195 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127355 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127514 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127673 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.127856 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128025 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128186 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128346 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128504 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128664 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.128839 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129000 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129161 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.31/identity {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129322 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129482 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129643 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129804 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.129965 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130126 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130286 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130447 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130605 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130767 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.130925 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131087 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131246 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131407 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131566 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131750 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.131912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132073 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132233 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132394 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132555 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132791 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.132921 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.133039 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.133436 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.133615 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.133869 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.133990 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.134198 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.135386 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.135569 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.135743 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.136188 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.136321 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.136482 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.136962 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.136962 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137214 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137214 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137441 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137560 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137687 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.137896 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.138142 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.138344 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.138751 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.138912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.139219 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.139532 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.139692 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.139872 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140038 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140194 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140332 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140481 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140629 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140793 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.140945 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141106 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141246 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141416 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141554 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141688 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.141865 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142009 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142156 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142310 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142469 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142632 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.142788 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143013 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143183 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143309 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143445 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143606 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143787 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.143943 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144110 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144264 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144264 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144525 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144673 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144816 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.144951 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145115 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145239 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145357 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145485 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145628 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145749 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.145912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146083 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146243 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146404 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146593 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146728 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.146888 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147046 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147210 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147368 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147528 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147690 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.147882 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148057 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148220 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148623 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148623 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.148912 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149098 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149212 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149368 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149521 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149662 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149826 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.149985 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150142 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150294 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150453 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.31/identity {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150608 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150763 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.150926 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151088 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151251 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151409 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151571 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151894 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.151894 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152202 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152202 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152445 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152571 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152710 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.152844 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153006 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153134 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153234 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153379 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153531 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153690 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.153850 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154008 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154168 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154328 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154490 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154650 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154811 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.154970 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155129 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155289 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155448 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155611 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155794 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.155955 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156115 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156274 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156434 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156594 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156757 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.156917 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157077 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157237 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157410 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157570 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157730 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.157890 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158050 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158210 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158369 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158531 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158690 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.158850 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159011 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159175 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159338 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159498 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159658 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.159847 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160009 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160168 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160328 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160502 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160661 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160821 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.160980 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161139 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161298 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161467 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161626 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161785 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.161943 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162102 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162260 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162429 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162588 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162747 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.162906 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163064 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163223 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163394 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163555 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163729 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.163892 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.164061 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.164198 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.164461 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.164638 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.164815 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165040 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165202 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165361 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165532 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165693 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.165852 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166012 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166172 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166331 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166499 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166663 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166827 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.166994 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167152 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167311 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167470 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167641 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167823 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.167987 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168147 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168306 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168466 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168626 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168792 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.168961 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169127 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169287 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169455 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169621 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169789 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.169951 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170121 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170292 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170454 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170615 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170774 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.170934 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171093 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171254 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171413 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171573 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171753 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.171915 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172073 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172233 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172393 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172553 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172714 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.172872 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.173033 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.173191 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.173352 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 17:39:49.173506 dv-cinder-788366-7-iscsi neutron-server[108034]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 17:39:49.315093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49718) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:39:49.326151 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [-] 10.222.0.31 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0072458 Nov 15 17:40:00.817067 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bebbbdc2-6b7d-44cc-bd34-5dfb5cfed714 None None] get_active_networks_info from dv-cinder-788366-7-iscsi {{(pid=108143) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 15 17:40:00.885626 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bebbbdc2-6b7d-44cc-bd34-5dfb5cfed714 None None] No non-hosted networks {{(pid=108143) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 15 17:40:00.899496 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.agentschedulers_db [None req-bebbbdc2-6b7d-44cc-bd34-5dfb5cfed714 None None] DHCP Agent not found on host dv-cinder-788366-7-iscsi {{(pid=108143) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 15 17:40:01.076872 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f57054e-fbf2-41d2-8167-f9fad7ad65f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:03.025950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4aaffbb9-cc64-43fb-8eec-f3d6c18579cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:03.088272 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9f5a1056-a0d0-4330-a0da-75dc6da94d6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:04.494546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:05.571396 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:06.094320 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.db.l3_hamode_db [None req-2b4ad601-4907-46b1-bbc2-20f1390a3673 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 15 17:40:06.174564 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b4ad601-4907-46b1-bbc2-20f1390a3673 None None] Routers set() bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:40:06.175029 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b4ad601-4907-46b1-bbc2-20f1390a3673 None None] Router IDs set() for agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 15 17:40:06.627157 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:06.628323 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.629109 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.629846 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.630601 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.630995 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.641401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.641813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.642230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.642559 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.642883 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.643224 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.643543 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:06.643945 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-788366-7-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:06.652815 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-788366-7-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:06.915176 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 49808) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:07.437334 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING oslo_policy.policy [None req-ff98f716-9662-44cd-b82a-eea78b7675b3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:07.437864 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING oslo_policy.policy [None req-ff98f716-9662-44cd-b82a-eea78b7675b3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:07.661339 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [None req-ff98f716-9662-44cd-b82a-eea78b7675b3 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:40:07.662582 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ff98f716-9662-44cd-b82a-eea78b7675b3 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7456975 Nov 15 17:40:10.220649 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 49824) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:10.566212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] Request body: {'subnetpool': {'is_default': True, 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'shared': True}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:10.660638 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.policy [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108141) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 15 17:40:10.709508 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING oslo_policy.policy [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:10.709874 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING oslo_policy.policy [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:10.718586 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.quota [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] Loaded quota_driver: . Nov 15 17:40:10.812030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762237437167', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762237437500', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762237424821', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762237419894', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762236819412', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762236829162', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3428745', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3438102', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-343483', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-421988'] for rbac-policy, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:10.884798 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:10.886105 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c33b5512-15e6-4e32-b615-a379dc0d6259 admin admin] 10.222.0.31 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6644163 Nov 15 17:40:13.629460 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 49836) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:13.944248 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Request body: {'network': {'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'name': 'private', 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:13.978569 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Made reservation on behalf of 0760b369d73d4bd7a6eac91bcb42dd70 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:40:13.981549 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:13.999063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.107663 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.114637 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.134232 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] vlan segment allocate from pool success with {'vlan_id': 410, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:40:14.161243 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8762238920897', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.161788 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Unsubscribe: segment precommit_create {{(pid=108141) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 15 17:40:14.162307 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Added segment b8c3da44-2fd2-453d-84d9-d4b6d088a015 of type vlan for network 071046c2-3285-4cf8-9235-27307a5284c7 Nov 15 17:40:14.178146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a3e2922-6170-475d-9315-df0e05057a9d,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:14.228364 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.228755 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.229082 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.229401 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.229712 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.230046 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.230361 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.230685 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.231009 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.231301 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.231596 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.231921 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Tracked resource versions report: Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: pushed versions: Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: { 'AddressGroup': {'1.2'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'ConntrackHelper': {'1.0'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Log': {'1.0'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Network': {'1.1'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Port': {'1.7'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'PortForwarding': {'1.2'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'QosPolicy': {'1.10'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroup': {'1.5'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SubPort': {'1.0'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Subnet': {'1.1'}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Trunk': {'1.1'}} Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: consumer versions: Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'ConntrackHelper': '1.0', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Log': '1.0', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Network': '1.1', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Port': '1.7', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'PortForwarding': '1.2', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'QosPolicy': '1.10', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroup': '1.5', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroupRule': '1.2', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SubPort': '1.0', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Subnet': '1.1', Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Trunk': '1.1'}} Nov 15 17:40:14.232992 dv-cinder-788366-7-iscsi neutron-server[108141]: {{(pid=108141) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:40:14.274705 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.318286 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.319589 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:14.320310 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:14.400429 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7697885 Nov 15 17:40:14.419318 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3021b2de-4207-4d44-8bf0-c3cbf3b42322 admin admin] Pushing event updated for resources: {'Network': ['ID=071046c2-3285-4cf8-9235-27307a5284c7,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:14.434941 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 071046c2-3285-4cf8-9235-27307a5284c7 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:40:17.224506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49850) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:17.788164 dv-cinder-788366-7-iscsi neutron-server[108142]: WARNING oslo_policy.policy [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:17.788988 dv-cinder-788366-7-iscsi neutron-server[108142]: WARNING oslo_policy.policy [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:18.231878 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.policy [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108142) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 15 17:40:18.278840 dv-cinder-788366-7-iscsi neutron-server[108142]: WARNING oslo_policy.policy [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:18.279197 dv-cinder-788366-7-iscsi neutron-server[108142]: WARNING oslo_policy.policy [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 17:40:18.287378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:18.289122 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-507134e0-592b-4fe7-9abd-cc575270a827 admin admin] 10.222.0.31 "GET /v2.0/networks/071046c2-3285-4cf8-9235-27307a5284c7 HTTP/1.1" status: 200 len: 825 time: 1.0634365 Nov 15 17:40:18.332941 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-626e683d-42bf-48d1-8a97-738159349089 admin admin] 10.222.0.31 "GET /v2.0/subnetpools/bac8d3ec-ca55-406c-8b3f-d36530ea6c4c HTTP/1.1" status: 200 len: 734 time: 0.0334883 Nov 15 17:40:18.345323 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'ip_version': 4, 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'name': 'private-subnet'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:18.346899 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.quota [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Loaded quota_driver: . Nov 15 17:40:18.388491 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Made reservation on behalf of 0760b369d73d4bd7a6eac91bcb42dd70 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:40:18.391345 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Publish callbacks [] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:18.715638 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:18.788551 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Checking segment: {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:40:18.788904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Network hostable DHCP agents. Network: 071046c2-3285-4cf8-9235-27307a5284c7, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:40:18.791077 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Pushing event updated for resources: {'Subnet': ['ID=f33a0720-6f8f-4f3a-bd73-64ef7fc78069,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:18.803531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.803908 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.804236 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.804555 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.804875 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.805212 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.805526 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.805850 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.806178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.806486 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.806791 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.807085 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Tracked resource versions report: Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: pushed versions: Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: { 'AddressGroup': {'1.2'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'ConntrackHelper': {'1.0'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Log': {'1.0'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Network': {'1.1'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Port': {'1.7'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'PortForwarding': {'1.2'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'QosPolicy': {'1.10'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroup': {'1.5'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SubPort': {'1.0'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Subnet': {'1.1'}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Trunk': {'1.1'}} Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: consumer versions: Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'ConntrackHelper': '1.0', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Log': '1.0', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Network': '1.1', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Port': '1.7', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'PortForwarding': '1.2', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'QosPolicy': '1.10', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroup': '1.5', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroupRule': '1.2', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SubPort': '1.0', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Subnet': '1.1', Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Trunk': '1.1'}} Nov 15 17:40:18.808592 dv-cinder-788366-7-iscsi neutron-server[108142]: {{(pid=108142) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:40:18.864496 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Network 071046c2-3285-4cf8-9235-27307a5284c7 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:40:18.881036 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 071046c2-3285-4cf8-9235-27307a5284c7) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:18.886060 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:18.886686 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:18.891558 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cc6948a-08ce-4b28-a2f0-33492e4bea78 None None] Network 071046c2-3285-4cf8-9235-27307a5284c7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:40:18.911354 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-33f68660-b904-47ff-9dbe-7e6c26f8ed5e admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5696342 Nov 15 17:40:19.218728 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-071046c2-3285-4cf8-9235-27307a5284c7', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:40:19.219952 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:19.516143 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Allocated IP 172.20.0.2 (071046c2-3285-4cf8-9235-27307a5284c7/f33a0720-6f8f-4f3a-bd73-64ef7fc78069/24800e3b-0c57-44c3-889b-b094fb774679) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:40:19.726847 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:19.735459 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:19.814405 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Network 071046c2-3285-4cf8-9235-27307a5284c7 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:40:19.819091 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:19.827459 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Pushing event updated for resources: {'Port': ['ID=24800e3b-0c57-44c3-889b-b094fb774679,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:19.827459 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:40:19.861866 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.862222 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.862559 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.862861 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.863190 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.863514 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.863865 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.864218 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.864550 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.864876 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.865199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.865513 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Tracked resource versions report: Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: pushed versions: Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: { 'AddressGroup': {'1.2'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'ConntrackHelper': {'1.0'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Log': {'1.0'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Network': {'1.1'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Port': {'1.7'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'PortForwarding': {'1.2'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'QosPolicy': {'1.10'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroup': {'1.5'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SubPort': {'1.0'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Subnet': {'1.1'}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Trunk': {'1.1'}} Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: consumer versions: Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'ConntrackHelper': '1.0', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Log': '1.0', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Network': '1.1', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Port': '1.7', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'PortForwarding': '1.2', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'QosPolicy': '1.10', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroup': '1.5', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroupRule': '1.2', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SubPort': '1.0', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Subnet': '1.1', Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Trunk': '1.1'}} Nov 15 17:40:19.866611 dv-cinder-788366-7-iscsi neutron-server[108143]: {{(pid=108143) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:40:19.915236 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Attempting to bind port 24800e3b-0c57-44c3-889b-b094fb774679 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:40:19.915893 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Attempting to bind port 24800e3b-0c57-44c3-889b-b094fb774679 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:40:19.915998 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Attempting to bind port 24800e3b-0c57-44c3-889b-b094fb774679 on network 071046c2-3285-4cf8-9235-27307a5284c7 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:40:19.921569 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 40, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:40:19.921956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Checking segment: {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:40:19.922423 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:19.922805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Bound using segment: {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:40:19.923284 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Bound port: 24800e3b-0c57-44c3-889b-b094fb774679, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:40:19.923689 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:19.987207 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] For port 24800e3b-0c57-44c3-889b-b094fb774679, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:40:19.991456 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] For port 24800e3b-0c57-44c3-889b-b094fb774679, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=24800e3b-0c57-44c3-889b-b094fb774679,segment=NetworkSegment(b8c3da44-2fd2-453d-84d9-d4b6d088a015),segment_id=b8c3da44-2fd2-453d-84d9-d4b6d088a015)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:40:19.998328 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:20.063981 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bec0bbc-42a5-4343-b51d-36bdb4557c78 None None] Pushing event updated for resources: {'Port': ['ID=24800e3b-0c57-44c3-889b-b094fb774679,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:21.469670 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49870) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:21.809599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [None req-5dbb7211-b73e-47bc-8978-0e8416a11699 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:40:21.810599 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-5dbb7211-b73e-47bc-8978-0e8416a11699 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3399787 Nov 15 17:40:24.370095 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49878) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:24.695605 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [None req-08d544ae-b292-4706-ae0b-054f2cf06cac admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:40:24.696620 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-08d544ae-b292-4706-ae0b-054f2cf06cac admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3255358 Nov 15 17:40:27.492896 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49888) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:27.814446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Request body: {'router': {'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'name': 'router1'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:27.844444 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:27.846151 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.001516 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.010588 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.032423 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.038359 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-d9f56de8-ea37-403f-8f1d-68772a0f880d admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5397043 Nov 15 17:40:28.500525 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 24800e3b-0c57-44c3-889b-b094fb774679 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:40:28.596680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 24800e3b-0c57-44c3-889b-b094fb774679 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:28.597063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.711172 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.749299 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 24800e3b-0c57-44c3-889b-b094fb774679, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=24800e3b-0c57-44c3-889b-b094fb774679,segment=NetworkSegment(b8c3da44-2fd2-453d-84d9-d4b6d088a015),segment_id=b8c3da44-2fd2-453d-84d9-d4b6d088a015)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:40:28.757242 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:28.806046 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=24800e3b-0c57-44c3-889b-b094fb774679,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:29.172188 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f7e2aab-4356-4bcb-a1d0-7ace4a7d09b2 None None] Network 071046c2-3285-4cf8-9235-27307a5284c7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:40:29.239625 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-cdfea471-5a29-4059-88fa-5f8616862f53 None None] Provisioning complete for port 24800e3b-0c57-44c3-889b-b094fb774679 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:29.240250 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cdfea471-5a29-4059-88fa-5f8616862f53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:29.607242 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8a69b490-44ad-49a0-88b7-e4f267de013d None None] Provisioning complete for port 24800e3b-0c57-44c3-889b-b094fb774679 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:29.607928 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8a69b490-44ad-49a0-88b7-e4f267de013d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:30.466424 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 24800e3b-0c57-44c3-889b-b094fb774679 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:40:30.514480 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 24800e3b-0c57-44c3-889b-b094fb774679 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:30.514840 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:30.612297 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49900) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:30.738594 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6efda85b-e190-4b55-876a-cd2e58e69bbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:30.950077 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [None req-043c5232-70db-4bd5-b4cd-cb36149f4b5d admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:40:30.951076 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-043c5232-70db-4bd5-b4cd-cb36149f4b5d admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3377967 Nov 15 17:40:33.019446 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ab62e359-dd93-41ef-b577-62b0a8d3a6d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:33.490088 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49908) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:33.858943 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Request body: {'network': {'name': 'public', 'is_default': True, 'router:external': True, 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'provider:network_type': 'flat'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:33.886189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Made reservation on behalf of ca8fc5f83e2c4bd091ae4a363049276c for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:40:33.888533 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:33.904034 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.008511 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.014622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.031506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Reserving flat network on physical network physnet1 {{(pid=108142) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 15 17:40:34.048961 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7807312-9d60-461a-b979-757df26af265,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:34.054615 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8762238920897', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.055163 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Unsubscribe: segment precommit_create {{(pid=108142) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 15 17:40:34.055782 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Added segment c49a3786-2afe-45a0-abea-ecf0c6157177 of type flat for network 5536583f-f2fb-4579-9b55-62f8818c8ea0 Nov 15 17:40:34.115746 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.162532 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.163552 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:34.164156 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:34.241532 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7499664 Nov 15 17:40:34.260455 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e9824d-3826-49e5-93eb-afa370664e31 admin admin] Pushing event updated for resources: {'Network': ['ID=5536583f-f2fb-4579-9b55-62f8818c8ea0,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:34.272285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:40:34.395248 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:35.498818 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:36.628546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:36.771496 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49926) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:36.963481 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f20aae5b-2ba8-43b4-b02d-b790b0833561 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:36.964859 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f20aae5b-2ba8-43b4-b02d-b790b0833561 admin admin] 10.222.0.31 "GET /v2.0/subnets/f33a0720-6f8f-4f3a-bd73-64ef7fc78069 HTTP/1.1" status: 200 len: 849 time: 0.1924012 Nov 15 17:40:37.081951 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4acaedf7-f29a-436d-a970-81fb95325617 admin admin] 10.222.0.31 "GET /v2.0/routers/692bd1e0-f99f-48fb-9247-c3da9bec01ca HTTP/1.1" status: 200 len: 704 time: 0.1106102 Nov 15 17:40:37.353986 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:37.657287 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Allocated IP 172.20.0.1 (071046c2-3285-4cf8-9235-27307a5284c7/f33a0720-6f8f-4f3a-bd73-64ef7fc78069/12c232fa-daf5-41b8-a7c6-5ffcf2161f49) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:40:37.812249 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:37.935190 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.005357 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Network 071046c2-3285-4cf8-9235-27307a5284c7 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:40:38.010289 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:38.019003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:40:38.019842 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.048721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Pushing event updated for resources: {'Port': ['ID=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:38.179736 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-188f1600-ac02-41ac-ac77-08112a575152 None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:38.179736 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-188f1600-ac02-41ac-ac77-08112a575152 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.212851 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-188f1600-ac02-41ac-ac77-08112a575152 None None] Port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:40:38.225409 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.442706 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.448680 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.449440 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.525389 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Pushing event updated for resources: {'Port': ['ID=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:38.576277 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Network 071046c2-3285-4cf8-9235-27307a5284c7 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:40:38.577763 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:38.737092 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8fa55af6-4574-4ca6-b730-4f50f8a3813a None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:38.737471 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8fa55af6-4574-4ca6-b730-4f50f8a3813a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:38.738740 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Router 692bd1e0-f99f-48fb-9247-c3da9bec01ca is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:40:38.773708 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-8fa55af6-4574-4ca6-b730-4f50f8a3813a None None] Port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:40:38.829147 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:40:38.834592 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-aeeb2e9c-fb12-4454-9038-a3465063bb0d admin admin] 10.222.0.31 "PUT /v2.0/routers/692bd1e0-f99f-48fb-9247-c3da9bec01ca/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7442782 Nov 15 17:40:38.852215 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Sync routers for ids ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:40:38.864636 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Routers {'692bd1e0-f99f-48fb-9247-c3da9bec01ca'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:40:38.865497 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:40:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:39.054664 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Set router 692bd1e0-f99f-48fb-9247-c3da9bec01ca gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:40:39.480106 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:38Z', 'revision_number': 2, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port_host': None, '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:38Z', 'revision_number': 2, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:39.531474 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Checking router: 692bd1e0-f99f-48fb-9247-c3da9bec01ca for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:40:39.531863 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Updating router 692bd1e0-f99f-48fb-9247-c3da9bec01ca port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:40:39.579589 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.085232 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.092800 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.232147 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Pushing event updated for resources: {'Port': ['ID=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:40.255803 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.256128 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.256486 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.256807 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.257125 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.257445 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.257760 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.258075 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.258362 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.258698 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.259009 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.259315 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Tracked resource versions report: Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: pushed versions: Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: { 'AddressGroup': {'1.2'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'ConntrackHelper': {'1.0'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Log': {'1.0'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Network': {'1.1'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Port': {'1.7'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'PortForwarding': {'1.2'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'QosPolicy': {'1.10'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroup': {'1.5'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SubPort': {'1.0'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Subnet': {'1.1'}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Trunk': {'1.1'}} Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: consumer versions: Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'ConntrackHelper': '1.0', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Log': '1.0', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Network': '1.1', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Port': '1.7', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'PortForwarding': '1.2', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'QosPolicy': '1.10', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroup': '1.5', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroupRule': '1.2', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SubPort': '1.0', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Subnet': '1.1', Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Trunk': '1.1'}} Nov 15 17:40:40.260607 dv-cinder-788366-7-iscsi neutron-server[108144]: {{(pid=108144) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:40:40.273919 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Attempting to bind port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:40:40.274320 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Attempting to bind port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:40:40.274737 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Attempting to bind port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 on network 071046c2-3285-4cf8-9235-27307a5284c7 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:40:40.280190 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 40, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:40:40.280601 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Checking segment: {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:40:40.281346 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.281724 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Bound using segment: {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:40:40.282214 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Bound port: 12c232fa-daf5-41b8-a7c6-5ffcf2161f49, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8c3da44-2fd2-453d-84d9-d4b6d088a015', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:40:40.282619 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.305457 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-d102e5cd-86dd-4faa-8395-d5c1c34b62ef None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:40.306564 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d102e5cd-86dd-4faa-8395-d5c1c34b62ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.347234 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-d102e5cd-86dd-4faa-8395-d5c1c34b62ef None None] Port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:40:40.350988 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] For port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:40:40.371109 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] For port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,segment=NetworkSegment(b8c3da44-2fd2-453d-84d9-d4b6d088a015),segment_id=b8c3da44-2fd2-453d-84d9-d4b6d088a015)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:40:40.376464 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.426998 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Routers {'692bd1e0-f99f-48fb-9247-c3da9bec01ca'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:40:40.427608 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:40:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:40.498884 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5606d2f4-ce80-4130-9ea2-b8af552d5d3d None None] Pushing event updated for resources: {'Port': ['ID=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:40.524778 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] Set router 692bd1e0-f99f-48fb-9247-c3da9bec01ca gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:40:40.674614 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:40.674873 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.742877 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:38Z', 'revision_number': 2, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port_host': None, '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:40Z', 'revision_number': 4, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:40.755371 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.768728 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5f8715-0d57-4400-b88b-577b658b1a46 None None] The sync data for ids ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'] in dv-cinder-788366-7-iscsi is: [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:38Z', 'revision_number': 2, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port_host': None, '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:40Z', 'revision_number': 4, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:40:40.791968 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] For port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,segment=NetworkSegment(b8c3da44-2fd2-453d-84d9-d4b6d088a015),segment_id=b8c3da44-2fd2-453d-84d9-d4b6d088a015)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:40:40.796904 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:40.845493 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583fdc55-3254-4b4e-a95f-39f93f7618dd None None] Pushing event updated for resources: {'Port': ['ID=12c232fa-daf5-41b8-a7c6-5ffcf2161f49,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:41.211199 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 49946) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:41.365515 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9433d4a6-0973-4519-bf46-f74dcbf0c4a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:41.366939 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9433d4a6-0973-4519-bf46-f74dcbf0c4a4 admin admin] 10.222.0.31 "GET /v2.0/networks/5536583f-f2fb-4579-9b55-62f8818c8ea0 HTTP/1.1" status: 200 len: 842 time: 0.1544368 Nov 15 17:40:41.378083 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Request body: {'subnet': {'gateway_ip': '172.27.0.1', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'name': 'public-subnet', 'cidr': '172.27.0.0/24', 'ip_version': 4, 'enable_dhcp': False}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:41.405295 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Made reservation on behalf of ca8fc5f83e2c4bd091ae4a363049276c for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:40:41.407629 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:41.820771 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.objects.ports [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=108141) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 15 17:40:41.821255 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:41.874084 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd734db9-2a5e-4bf6-98ea-2ce68d800b8c,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:41.893851 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:40:41.894235 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Network hostable DHCP agents. Network: 5536583f-f2fb-4579-9b55-62f8818c8ea0, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:40:41.923596 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:40:41.937028 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 5536583f-f2fb-4579-9b55-62f8818c8ea0) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:41.942331 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:41.942942 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:41.949271 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f44a43cc-40ef-4ffb-a0dd-e386abb752b8 None None] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:40:41.963912 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-a993fce6-99b5-49ac-b675-8005ec3b2bbb admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5879743 Nov 15 17:40:42.091020 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56aebf86-cb37-429b-9e82-bf839e6ccd0b None None] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:40:43.036928 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:40:44.402642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 49954) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:44.638567 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e29b1f00-e3eb-42dc-9ebf-7676ce860dad admin admin] 10.222.0.31 "GET /v2.0/routers/692bd1e0-f99f-48fb-9247-c3da9bec01ca HTTP/1.1" status: 200 len: 710 time: 0.2346668 Nov 15 17:40:44.728543 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c970ade7-42ea-4d98-8038-4fa4e147ed23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:40:44.730682 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c970ade7-42ea-4d98-8038-4fa4e147ed23 admin admin] 10.222.0.31 "GET /v2.0/networks/5536583f-f2fb-4579-9b55-62f8818c8ea0 HTTP/1.1" status: 200 len: 886 time: 0.0859609 Nov 15 17:40:44.739606 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:40:44.983616 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:45.217604 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:45.296213 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:45.504135 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Allocated IP 172.27.0.30 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/9de38e58-7b1e-4b19-bb32-c522aa2fdde4) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:40:45.615851 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:45.681316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:45.755356 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:40:45.760217 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:40:45.766696 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:40:45.772255 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Pushing event updated for resources: {'Port': ['ID=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:46.069929 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:46.296594 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3753790', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3764657', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-755'] for router, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:46.302348 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3753761', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3753768', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3764664'] for router, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:46.427731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Router 692bd1e0-f99f-48fb-9247-c3da9bec01ca has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:40:46.516167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:40:46.547833 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:40:46.552344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:46.559607 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0ff1a2f8-4485-4174-b693-f1be7b8b4db5 admin admin] 10.222.0.31 "PUT /v2.0/routers/692bd1e0-f99f-48fb-9247-c3da9bec01ca HTTP/1.1" status: 200 len: 889 time: 1.8171864 Nov 15 17:40:46.566013 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:46.566370 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:47.789867 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Sync routers for ids ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:40:47.802404 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Routers {'692bd1e0-f99f-48fb-9247-c3da9bec01ca'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:40:47.803103 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:40:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:48.010448 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Set router 692bd1e0-f99f-48fb-9247-c3da9bec01ca gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:40:48.462229 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:45Z', 'revision_number': 4, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port': {'id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:91:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:45Z', 'updated_at': '2021-11-15T17:40:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:40Z', 'revision_number': 5, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:48.513070 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Checking router: 692bd1e0-f99f-48fb-9247-c3da9bec01ca for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:40:48.513417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Updating router 692bd1e0-f99f-48fb-9247-c3da9bec01ca port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:40:48.559721 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:48.892815 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:48.899186 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:48.950190 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Attempting to bind port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:40:48.950560 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Attempting to bind port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:40:48.950924 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Attempting to bind port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:40:48.953716 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d156c413-9cc7-4278-87ec-e59a433bc1b0 None None] Pushing event updated for resources: {'Port': ['ID=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:48.958586 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 40, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:40:48.958957 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:40:48.959354 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:48.959751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:40:48.960219 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Bound port: 9de38e58-7b1e-4b19-bb32-c522aa2fdde4, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:40:48.960611 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:49.012809 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] For port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:40:49.017741 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] For port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:40:49.024704 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:49.076618 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 49966) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:40:49.091303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d156c413-9cc7-4278-87ec-e59a433bc1b0 None None] Pushing event updated for resources: {'Port': ['ID=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:49.096715 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Routers {'692bd1e0-f99f-48fb-9247-c3da9bec01ca'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:40:49.097327 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:40:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:49.191737 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-87d48f8f-8175-4d4d-ad7e-ba48a58e39d6 admin admin] 10.222.0.31 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1138017 Nov 15 17:40:49.206409 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] Set router 692bd1e0-f99f-48fb-9247-c3da9bec01ca gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:40:49.437423 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:45Z', 'revision_number': 4, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port': {'id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:91:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:45Z', 'updated_at': '2021-11-15T17:40:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:40Z', 'revision_number': 5, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:40:49.463749 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65148fa1-1301-46a9-bcf1-07fb4d3e052e None None] The sync data for ids ['692bd1e0-f99f-48fb-9247-c3da9bec01ca'] in dv-cinder-788366-7-iscsi is: [{'id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'name': 'router1', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30'}], 'enable_snat': True}, 'gw_port_id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:40:27Z', 'updated_at': '2021-11-15T17:40:45Z', 'revision_number': 4, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'gw_port': {'id': '9de38e58-7b1e-4b19-bb32-c522aa2fdde4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:a6:91:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:45Z', 'updated_at': '2021-11-15T17:40:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '12c232fa-daf5-41b8-a7c6-5ffcf2161f49', 'name': '', 'network_id': '071046c2-3285-4cf8-9235-27307a5284c7', 'tenant_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'mac_address': 'fa:16:3e:ec:c3:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692bd1e0-f99f-48fb-9247-c3da9bec01ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:40:37Z', 'updated_at': '2021-11-15T17:40:40Z', 'revision_number': 5, 'project_id': '0760b369d73d4bd7a6eac91bcb42dd70', 'subnets': [{'id': 'f33a0720-6f8f-4f3a-bd73-64ef7fc78069', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bac8d3ec-ca55-406c-8b3f-d36530ea6c4c'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:40:50.500268 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:40:50.565397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:50.565767 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:50.645974 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:50.668285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:40:50.675203 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:40:50.723203 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=9de38e58-7b1e-4b19-bb32-c522aa2fdde4,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:40:52.493171 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:40:52.549535 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 9de38e58-7b1e-4b19-bb32-c522aa2fdde4 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:40:52.549895 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:00.743227 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4d6a2125-7980-4ec4-bae5-011af3999593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:03.046558 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2ad0f3ec-34c6-4653-a559-e2a5d9c398be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:04.397400 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:05.507551 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:06.646153 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:20.037687 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:41:30.762199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ae76710e-eedb-4b54-96b7-9eda3d01819f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:33.025206 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-35cbe30f-4202-4bdb-b69e-f8e83c3aa5d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:34.399900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:35.500961 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:36.644956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:41:57.037459 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:42:00.737363 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-606b7b74-c981-4f6c-bed8-a913b7f06e3c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:03.031230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ad3ff0a4-1b66-4719-8f03-83db1b783ae7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:04.396954 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:05.499273 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:06.650929 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:26.971570 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 50528) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:27.053437 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.pecan_wsgi.hooks.translation [None req-aef4528f-ae35-40df-984f-25c601224810 admin admin] GET failed (client error): The resource could not be found. Nov 15 17:42:27.054886 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-aef4528f-ae35-40df-984f-25c601224810 admin admin] 10.222.0.31 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0820551 Nov 15 17:42:27.219260 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74221a4a-819f-4f06-a434-cc565177cb9b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:27.220762 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-74221a4a-819f-4f06-a434-cc565177cb9b admin admin] 10.222.0.31 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1594856 Nov 15 17:42:29.545711 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 50538) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:29.666407 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cf29235-8fb9-4abc-bdb8-a822bba66608 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:29.667817 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4cf29235-8fb9-4abc-bdb8-a822bba66608 admin admin] 10.222.0.31 "GET /v2.0/subnets/f33a0720-6f8f-4f3a-bd73-64ef7fc78069 HTTP/1.1" status: 200 len: 849 time: 0.1207731 Nov 15 17:42:29.677879 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:42:29.769917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Publish callbacks [] for subnet, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:30.006267 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762238850214'] for subnet, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:30.034925 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:30.035427 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:30.036707 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] 10.222.0.31 "PUT /v2.0/subnets/f33a0720-6f8f-4f3a-bd73-64ef7fc78069 HTTP/1.1" status: 200 len: 868 time: 0.3625674 Nov 15 17:42:30.054973 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-120d95ae-aa31-4437-9780-f013c51aa01b None None] Network 071046c2-3285-4cf8-9235-27307a5284c7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:42:30.056786 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f33a0720-6f8f-4f3a-bd73-64ef7fc78069,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:42:30.065263 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.066022 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.066688 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.067449 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.068032 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.068608 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.069145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.069707 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.070464 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.071187 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.071753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.072322 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a3f77a-bf43-4dda-b457-0a44012cacb7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:42:30.397017 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-cc8b3daf-e7bc-4d98-a84f-966853407aab None None] Provisioning complete for port 24800e3b-0c57-44c3-889b-b094fb774679 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:42:30.397382 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cc8b3daf-e7bc-4d98-a84f-966853407aab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:30.487198 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-cc8b3daf-e7bc-4d98-a84f-966853407aab None None] Provisioning complete for port 12c232fa-daf5-41b8-a7c6-5ffcf2161f49 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:42:30.487567 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cc8b3daf-e7bc-4d98-a84f-966853407aab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:30.741583 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c7321c8b-de85-4d2c-a056-dd559b0f42b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:32.351871 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50546) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:32.560814 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a46be9-72fa-4dbb-8a73-bd12b34f70e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:32.561397 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a46be9-72fa-4dbb-8a73-bd12b34f70e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:32.563599 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-23a46be9-72fa-4dbb-8a73-bd12b34f70e7 admin admin] 10.222.0.31 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2107155 Nov 15 17:42:33.028280 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2ab49e01-e657-4453-8e06-4c36b1bc5053 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:34.036034 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:42:34.401656 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:34.881844 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50556) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:35.089582 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d97e8e5-98c7-4ccc-972f-cba609295f34 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:35.090050 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d97e8e5-98c7-4ccc-972f-cba609295f34 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:35.091615 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5d97e8e5-98c7-4ccc-972f-cba609295f34 admin admin] 10.222.0.31 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2087932 Nov 15 17:42:35.502431 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:36.650506 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:42:37.411584 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50564) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:37.565713 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7683c9b8-85bc-4269-8405-50ac04ba7d1b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:37.567097 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7683c9b8-85bc-4269-8405-50ac04ba7d1b admin admin] 10.222.0.31 "GET /v2.0/networks/071046c2-3285-4cf8-9235-27307a5284c7 HTTP/1.1" status: 200 len: 869 time: 0.1545115 Nov 15 17:42:39.957480 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50572) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:40.108229 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-917582c8-5b35-473e-ae0c-576fd4b6821c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:40.109639 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-917582c8-5b35-473e-ae0c-576fd4b6821c admin admin] 10.222.0.31 "GET /v2.0/networks/5536583f-f2fb-4579-9b55-62f8818c8ea0 HTTP/1.1" status: 200 len: 886 time: 0.1509736 Nov 15 17:42:42.433919 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50580) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:42.563212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90b3b85e-cfe2-4a38-ad40-80df0bcde1ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:42.563662 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90b3b85e-cfe2-4a38-ad40-80df0bcde1ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:42.565225 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-90b3b85e-cfe2-4a38-ad40-80df0bcde1ff admin admin] 10.222.0.31 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1303480 Nov 15 17:42:44.876580 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50590) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:44.987311 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e469c42-972a-43f6-914e-782f5889cc5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:44.987892 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e469c42-972a-43f6-914e-782f5889cc5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:44.990230 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-1e469c42-972a-43f6-914e-782f5889cc5d admin admin] 10.222.0.31 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1124399 Nov 15 17:42:47.309958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50598) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:47.405390 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fd3486c-569d-4b04-bb72-52fed6e8b59b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:47.406818 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5fd3486c-569d-4b04-bb72-52fed6e8b59b admin admin] 10.222.0.31 "GET /v2.0/subnets/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c HTTP/1.1" status: 200 len: 816 time: 0.0955515 Nov 15 17:42:49.704406 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50606) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:42:49.840006 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52253d33-9448-447a-8dc0-725520db9137 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:42:49.841379 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-52253d33-9448-447a-8dc0-725520db9137 admin admin] 10.222.0.31 "GET /v2.0/subnets/f33a0720-6f8f-4f3a-bd73-64ef7fc78069 HTTP/1.1" status: 200 len: 868 time: 0.1360052 Nov 15 17:43:00.745945 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9838ccce-d023-42a9-9e30-8a47b3aea78f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:03.037223 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c7842ed-f432-474c-b49a-2314a1d7b065 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:04.403599 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:05.507267 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:06.647854 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:11.035446 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:43:14.568840 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50660) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:43:14.622725 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [None req-bda7337b-5d30-48a3-8c49-f7bc305919c1 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:43:14.624202 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-bda7337b-5d30-48a3-8c49-f7bc305919c1 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0542424 Nov 15 17:43:17.122142 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50668) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:43:17.185372 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0ca8bb3-3456-4524-9b2f-04804a5419ed admin admin] GET failed (client error): The resource could not be found. Nov 15 17:43:17.186672 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c0ca8bb3-3456-4524-9b2f-04804a5419ed admin admin] 10.222.0.31 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0635853 Nov 15 17:43:17.345450 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03e72a00-a75a-43f3-89f0-086cb881d023 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:43:17.346844 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-03e72a00-a75a-43f3-89f0-086cb881d023 admin admin] 10.222.0.31 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1536992 Nov 15 17:43:19.681671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50676) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:43:19.731208 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:43:19.753737 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Made reservation on behalf of ca8fc5f83e2c4bd091ae4a363049276c for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:43:19.756021 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:19.792752 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING neutron.services.revisions.revision_plugin [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Could not find related network for resource to bump revision. Nov 15 17:43:19.805535 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] vlan segment allocate from pool success with {'vlan_id': 403, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:43:19.814951 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:19.815279 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Added segment adea3c81-84f8-4338-a68e-9347d5ee6eec of type vlan for network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 Nov 15 17:43:19.853833 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:19.878598 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:19.879577 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:43:19.880244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:19.928953 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2462072 Nov 15 17:43:19.939492 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Pushing event updated for resources: {'Network': ['ID=54e84c9d-4ab3-44fd-a688-9b14f9d90f42,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:43:19.946878 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.947247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.947560 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.947920 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.948256 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.948588 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.948912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.949247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.949578 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.949898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.950192 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.950499 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab68f481-b750-4e60-a29c-b428e81a5a8a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:19.962495 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:43:22.294903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50684) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:43:22.370010 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c41f938-1c49-488a-9fb0-96fbd2b9ffdb admin admin] GET failed (client error): The resource could not be found. Nov 15 17:43:22.371309 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2c41f938-1c49-488a-9fb0-96fbd2b9ffdb admin admin] 10.222.0.31 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0750768 Nov 15 17:43:22.444427 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb2e0bf4-5cff-497a-a580-f642b23e477e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:43:22.445837 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-cb2e0bf4-5cff-497a-a580-f642b23e477e admin admin] 10.222.0.31 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0673575 Nov 15 17:43:22.456246 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Request body: {'subnet': {'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42', 'cidr': '192.168.233.0/24', 'ip_version': 4, 'name': 'shared-subnet', 'description': 'shared-subnet'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:43:22.480802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Made reservation on behalf of ca8fc5f83e2c4bd091ae4a363049276c for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:43:22.484597 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:22.662594 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:22.717587 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=59fc9c38-3053-45b9-8ec0-f51e391e8e28,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:43:22.741687 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Checking segment: {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:43:22.741978 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Network hostable DHCP agents. Network: 54e84c9d-4ab3-44fd-a688-9b14f9d90f42, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:43:22.763119 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:43:22.773604 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 54e84c9d-4ab3-44fd-a688-9b14f9d90f42) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:43:22.778141 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:43:22.778730 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:22.784104 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7d5c8f5-3ad7-43c4-8e47-51daeabf7ed1 None None] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:43:22.795710 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9318862a-aa86-4f57-93ad-01568918f3e1 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3428082 Nov 15 17:43:22.938230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-54e84c9d-4ab3-44fd-a688-9b14f9d90f42', 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42', 'tenant_id': 'ca8fc5f83e2c4bd091ae4a363049276c', 'fixed_ips': [{'subnet_id': '59fc9c38-3053-45b9-8ec0-f51e391e8e28'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:43:22.939267 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.084303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Allocated IP 192.168.233.2 (54e84c9d-4ab3-44fd-a688-9b14f9d90f42/59fc9c38-3053-45b9-8ec0-f51e391e8e28/389c71ca-866a-4b08-92d3-13909aa1dd6b) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:43:23.224180 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.231182 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.282764 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:43:23.284181 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Pushing event updated for resources: {'Port': ['ID=389c71ca-866a-4b08-92d3-13909aa1dd6b,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:43:23.286385 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:43:23.292323 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:43:23.295841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.296204 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.296546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.296880 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.297210 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.297533 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.297855 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.298711 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.298711 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.298921 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.299121 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.299442 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:43:23.352403 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Attempting to bind port 389c71ca-866a-4b08-92d3-13909aa1dd6b on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:43:23.352806 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Attempting to bind port 389c71ca-866a-4b08-92d3-13909aa1dd6b by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:43:23.353178 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Attempting to bind port 389c71ca-866a-4b08-92d3-13909aa1dd6b on network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:43:23.358689 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 43, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:43:23.359060 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Checking segment: {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:43:23.359467 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.360677 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Bound using segment: {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:43:23.360677 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Bound port: 389c71ca-866a-4b08-92d3-13909aa1dd6b, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:43:23.360910 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.422983 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] For port 389c71ca-866a-4b08-92d3-13909aa1dd6b, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:43:23.426506 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] For port 389c71ca-866a-4b08-92d3-13909aa1dd6b, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=389c71ca-866a-4b08-92d3-13909aa1dd6b,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:43:23.430813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:23.495355 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb386e1c-612e-44e6-be4d-c5ce5dc106f7 None None] Pushing event updated for resources: {'Port': ['ID=389c71ca-866a-4b08-92d3-13909aa1dd6b,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:43:24.273588 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00b48e4a-7d3b-4a86-9c33-79f5a0228e92 None None] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:43:24.333883 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] Provisioning complete for port 389c71ca-866a-4b08-92d3-13909aa1dd6b triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:43:24.334245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:24.485880 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:24.524028 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] For port 389c71ca-866a-4b08-92d3-13909aa1dd6b, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=389c71ca-866a-4b08-92d3-13909aa1dd6b,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:43:24.529341 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:24.598557 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf75026-b453-43e7-a91e-f56669aa496f None None] Pushing event updated for resources: {'Port': ['ID=389c71ca-866a-4b08-92d3-13909aa1dd6b,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:43:24.635577 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 389c71ca-866a-4b08-92d3-13909aa1dd6b up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:43:24.696936 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 389c71ca-866a-4b08-92d3-13909aa1dd6b triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:43:24.697318 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:24.774288 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-cad13f3f-e9a4-4134-8eba-e5530ce64e79 None None] Provisioning complete for port 389c71ca-866a-4b08-92d3-13909aa1dd6b triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:43:24.774540 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cad13f3f-e9a4-4134-8eba-e5530ce64e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:26.563463 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 389c71ca-866a-4b08-92d3-13909aa1dd6b up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:43:26.611051 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 389c71ca-866a-4b08-92d3-13909aa1dd6b triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:43:26.611398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:30.748866 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-50793cd9-d408-4b3b-98fa-71260d25a4e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:33.032616 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-696a950c-2fa1-4aff-a559-9e3c0b4477ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:34.406545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:35.514146 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:36.654413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:43:48.034542 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:44:00.760434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8b8444e4-5a7e-4b7b-9075-6b6815785cb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:03.036558 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a88b4fac-c340-4d93-b349-8d1d65b2d971 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:04.412839 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:05.511683 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:06.649515 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:25.035925 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:44:30.755363 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6a900216-b5f0-4326-ab3f-e8d2fe4521b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:33.040933 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-dd7cf0e6-d60a-4b00-9c97-2edd4ed89739 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:34.415680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:35.518625 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:36.646019 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:46.670347 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50728) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:44:46.676295 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [None req-3a197955-d6f8-4607-9e1b-3d54359e54de tempest-verify_tempest_config-1220409870 tempest-verify_tempest_config-1220409870-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:44:46.677241 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3a197955-d6f8-4607-9e1b-3d54359e54de tempest-verify_tempest_config-1220409870 tempest-verify_tempest_config-1220409870-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058458 Nov 15 17:44:47.005985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 50746) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:44:47.118284 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.197777 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.203128 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.245510 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bbd8ee1-e523-41c4-80dc-7a933567382e,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:44:47.250390 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d5a6f4bb7e574a449c5b9c9ff9683098&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2433970 Nov 15 17:44:47.253440 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50752) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:44:47.254696 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.255055 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.255387 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.255683 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.256064 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.256386 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.256706 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.257024 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.257354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.257654 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.257973 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.258281 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54e697ab-d3d2-4802-a73b-838921665b63 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.310683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.331371 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.422311 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.424837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:44:47.425993 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4bbd8ee1-e523-41c4-80dc-7a933567382e HTTP/1.1" status: 204 len: 168 time: 0.1715870 Nov 15 17:44:47.433655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bbd8ee1-e523-41c4-80dc-7a933567382e,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:44:47.440307 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.440673 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.441013 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.441344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.441668 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.442009 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.442336 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.442677 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.442982 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.443297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.443640 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:44:47.443994 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bcee9c1f-b8f8-4a76-a023-113a08424645 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:45:00.764458 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a2a90983-5487-4f5e-ad59-4c6ec3b19864 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:02.037453 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:45:03.051757 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4ae37e9d-012e-4abb-93f2-d7c698589368 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:04.419605 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:05.526847 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:06.664055 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:30.759445 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6b0fae7a-7863-4b38-ab1e-a2fc093e145a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:33.056524 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-15c2436d-d61c-4a11-9b0a-8e7615913340 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:34.425145 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:35.531817 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:36.659893 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:45:39.037443 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:46:00.768347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c47c8a3d-7110-4ca3-9979-b7f7be63f37d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:03.055493 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-05592b9e-e98c-43d9-92d4-af4a09384f2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:04.431299 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:05.536763 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:06.648841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:16.036600 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 5 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:46:21.728096 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3755048'] for agent, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:30.763306 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-12c40d9e-78ae-4efd-bbe6-c0581eccc649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:33.049785 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d6734300-a1cb-4d0d-8654-9f2a58667ca9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:34.438612 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:35.538557 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:36.647177 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:37.177285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 50826) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:46:37.302153 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-32c966b1-aa08-49ab-a4d1-c961929a4e46 admin admin] 10.222.0.31 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1233647 Nov 15 17:46:39.639782 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 50836) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:46:39.709766 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a2264958-1cac-4391-bd83-4ee346ddb8a8 admin admin] 10.222.0.31 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0688453 Nov 15 17:46:51.686108 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:46:53.040778 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:47:00.768519 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4cc7e769-4e3f-423a-8580-c546f2acb440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:03.062152 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8122c950-ea1a-43df-9de0-b143f7e17f8c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:04.435406 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:05.542882 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:06.652185 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:21.690321 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:30.040376 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:47:30.773970 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-11b37591-153b-4abc-870e-d87cd8b178cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:33.056167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5dd7fcc7-6d99-44f0-94ba-67130b95f807 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:34.438545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:35.561900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:36.670668 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:47:51.692637 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:00.770890 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e19edfe9-5bfb-4ad3-b979-fe7b0c5cd7bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:03.060543 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d37edcce-7a8c-42c0-9124-9e73c1c63993 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:04.439554 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:05.564398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:06.665110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:07.042450 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:48:09.909174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51044) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:10.029926 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51054) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:10.043994 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51058) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:10.229454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-network', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:10.252631 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Made reservation on behalf of ea39cfbc451d47108eac0fac5c2f4873 for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:10.255362 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.264204 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.317353 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51074) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:10.350099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.354892 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.384751 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] vlan segment allocate from pool success with {'vlan_id': 444, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:10.394797 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4876c2de-52d0-4a8c-8e90-62cd58821014,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:10.408732 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1347461488-network', 'tenant_id': '04f55f51f2b5414d837b134a5c85985c'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:10.412100 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.412442 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Added segment b562ff7b-8aea-4e14-99e1-0c669a0cb625 of type vlan for network f25d23f6-7f59-4624-979f-a398984b16c9 Nov 15 17:48:10.427318 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.427774 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.428198 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.428596 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.428927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.429319 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.429939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.430286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.430632 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.430946 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.431423 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.431771 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Tracked resource versions report: Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: pushed versions: Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: { 'AddressGroup': {'1.2'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'ConntrackHelper': {'1.0'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Log': {'1.0'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Network': {'1.1'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Port': {'1.7'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'PortForwarding': {'1.2'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'QosPolicy': {'1.10'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroup': {'1.5'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SubPort': {'1.0'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Subnet': {'1.1'}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Trunk': {'1.1'}} Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: consumer versions: Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: HyperV agent@hv-cinder-78836: {}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'ConntrackHelper': '1.0', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Log': '1.0', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Network': '1.1', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Port': '1.7', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'PortForwarding': '1.2', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'QosPolicy': '1.10', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroup': '1.5', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SecurityGroupRule': '1.2', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'SubPort': '1.0', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Subnet': '1.1', Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: 'Trunk': '1.1'}} Nov 15 17:48:10.432912 dv-cinder-788366-7-iscsi neutron-server[108142]: {{(pid=108142) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:48:10.445132 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1549537088-network', 'tenant_id': '230fd761d538456998d7b335d14192ff'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:10.495225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Made reservation on behalf of 04f55f51f2b5414d837b134a5c85985c for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:10.497521 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.503839 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.516115 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.534817 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Made reservation on behalf of 230fd761d538456998d7b335d14192ff for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:10.537089 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.561401 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.572618 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.573559 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:10.574330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.624455 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1345490248-network', 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:10.665428 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:10.670097 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.679070 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.683259 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] Pushing event updated for resources: {'Network': ['ID=f25d23f6-7f59-4624-979f-a398984b16c9,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:10.703517 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network f25d23f6-7f59-4624-979f-a398984b16c9 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:10.746298 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51102) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:10.746473 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-21be8775-3fb1-4357-b3cb-77a6f3d0cc2e admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.8358560 Nov 15 17:48:10.756247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Request body: {'subnet': {'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-subnet', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:10.865192 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Made reservation on behalf of ea39cfbc451d47108eac0fac5c2f4873 for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:10.868821 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.940853 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.958847 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:10.973051 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] vlan segment allocate from pool success with {'vlan_id': 436, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:10.976645 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.002366 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.002715 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Added segment c9c85cd9-2596-49ad-ac18-9a7fdef83b16 of type vlan for network c6711a21-f84e-4a09-b311-4dc71011fb84 Nov 15 17:48:11.007873 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.038448 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.071203 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.088379 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52d54288-df95-4dd1-966e-7c26bef58326,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.103810 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.107174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] vlan segment allocate from pool success with {'vlan_id': 409, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:11.132368 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] vlan segment allocate from pool success with {'vlan_id': 431, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:11.134705 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.178329 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.178649 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Added segment 65df5835-7d4f-417d-9f6f-35166467b466 of type vlan for network e40bb745-7523-4329-91e3-c55442c5a8fa Nov 15 17:48:11.179907 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab736546-634e-4bae-bc84-334ff5d7767f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.228039 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.229353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:11.230167 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.243225 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=742e6151-6dd5-4b0b-a0b5-305643083373,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.246643 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.259448 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.259816 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Added segment c2c03eb5-8651-4f4e-bbb7-e7f1b266074d of type vlan for network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 Nov 15 17:48:11.267744 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.268140 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.268504 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.268832 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.269149 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.269744 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.270285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.270940 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.271476 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.272000 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.272504 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.273336 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Tracked resource versions report: Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: pushed versions: Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: { 'AddressGroup': {'1.2'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'ConntrackHelper': {'1.0'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Log': {'1.0'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Network': {'1.1'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Port': {'1.7'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'PortForwarding': {'1.2'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'QosPolicy': {'1.10'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroup': {'1.5'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SubPort': {'1.0'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Subnet': {'1.1'}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Trunk': {'1.1'}} Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: consumer versions: Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: HyperV agent@hv-cinder-78836: {}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'ConntrackHelper': '1.0', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Log': '1.0', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Network': '1.1', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Port': '1.7', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'PortForwarding': '1.2', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'QosPolicy': '1.10', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroup': '1.5', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SecurityGroupRule': '1.2', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'SubPort': '1.0', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Subnet': '1.1', Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: 'Trunk': '1.1'}} Nov 15 17:48:11.275532 dv-cinder-788366-7-iscsi neutron-server[108141]: {{(pid=108141) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:48:11.297543 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9b912b7e-3193-418b-9139-60018a571278,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.374837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Checking segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:11.375657 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Network hostable DHCP agents. Network: f25d23f6-7f59-4624-979f-a398984b16c9, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:11.380901 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.384168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.db.resource_extend [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 15 17:48:11.412860 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Network f25d23f6-7f59-4624-979f-a398984b16c9 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:11.423266 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.424486 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:11.425085 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.426511 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.3954515 Nov 15 17:48:11.432640 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51124) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:11.455125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Request body: {'subnet': {'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1347461488-subnet', 'tenant_id': '04f55f51f2b5414d837b134a5c85985c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:11.464825 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, f25d23f6-7f59-4624-979f-a398984b16c9) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:11.469539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331efc62-8db5-4c4f-ba0c-eebeec303311 admin admin] Pushing event updated for resources: {'Network': ['ID=c6711a21-f84e-4a09-b311-4dc71011fb84,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.483298 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.485604 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-476c5ab3-4483-46a7-b5a9-282cdc95e634 None None] Network f25d23f6-7f59-4624-979f-a398984b16c9 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:11.486200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:11.491552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] Pushing event updated for resources: {'Network': ['ID=3919dfc4-3e42-4144-97e7-2ccb5146f2a2,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.496055 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network c6711a21-f84e-4a09-b311-4dc71011fb84 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:11.500314 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.513682 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:11.514512 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.579987 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] Pushing event updated for resources: {'Network': ['ID=e40bb745-7523-4329-91e3-c55442c5a8fa,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:11.583952 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Made reservation on behalf of 04f55f51f2b5414d837b134a5c85985c for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:11.586421 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.594555 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-1134ccae-349c-4905-93f1-5f260b98e0d1 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.8468039 Nov 15 17:48:11.599256 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51134) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:11.603256 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0013e357-bc16-415a-8892-b7c1240a2b63 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.2847989 Nov 15 17:48:11.603919 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51136) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:11.609980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Request body: {'subnet': {'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1345490248-subnet', 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:11.642457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:11.661932 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-42cb9f3d-b1a9-4739-bce1-e6c829f14dfd admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6153538 Nov 15 17:48:11.665424 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51140) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:11.684198 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Request body: {'subnet': {'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1549537088-subnet', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:11.704522 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:11.705128 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:11.711133 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.735503 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.736581 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:11.766735 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network e40bb745-7523-4329-91e3-c55442c5a8fa details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:11.918213 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.086546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fe0997f-fc01-489e-aafc-bb89c3dfcdfc None None] Network f25d23f6-7f59-4624-979f-a398984b16c9 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:12.165146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Made reservation on behalf of 230fd761d538456998d7b335d14192ff for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:12.167983 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.287075 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.385046 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.431109 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.466939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Pushing event updated for resources: {'Subnet': ['ID=28e89ccf-c78a-4f2e-be95-0646f1dfc889,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:12.486401 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Checking segment: {'id': 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:12.486753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Network hostable DHCP agents. Network: c6711a21-f84e-4a09-b311-4dc71011fb84, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:12.527647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Network c6711a21-f84e-4a09-b311-4dc71011fb84 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:12.551839 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6a2eeae-0fac-4586-be17-093ae2e28ec5,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:12.572238 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Checking segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:12.572708 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Network hostable DHCP agents. Network: 3919dfc4-3e42-4144-97e7-2ccb5146f2a2, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:12.583529 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.610532 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51194) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:12.612911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, c6711a21-f84e-4a09-b311-4dc71011fb84) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:12.624105 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-420e4c33-0014-4b6c-9754-b57eac1ac581 None None] Network c6711a21-f84e-4a09-b311-4dc71011fb84 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:12.627828 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:12.641444 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:12.642170 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.644072 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 3919dfc4-3e42-4144-97e7-2ccb5146f2a2) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:12.669584 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:12.670540 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.673038 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Pushing event updated for resources: {'Subnet': ['ID=ceb6358c-736e-42b9-8a34-e129c4912f6f,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:12.698039 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Checking segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:12.698730 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Network hostable DHCP agents. Network: e40bb745-7523-4329-91e3-c55442c5a8fa, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:12.706115 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-04c0c6fb-4128-4c0b-97f1-58335e829916 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.1011751 Nov 15 17:48:12.726809 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Network e40bb745-7523-4329-91e3-c55442c5a8fa is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:12.741622 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-54e6b0e5-090b-48ee-bc64-e38251dd4100 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2954221 Nov 15 17:48:12.741622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.743740 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-285198f1-5ca2-4821-82da-d06ee2489953 None None] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:12.754187 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, e40bb745-7523-4329-91e3-c55442c5a8fa) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:12.760533 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:12.761213 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.768474 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.788356 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-1965e525-7222-470e-a247-755ab69d66ae admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1217785 Nov 15 17:48:12.791827 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51206) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:12.806734 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:12.808925 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f007f3e3-041c-4cb5-8270-deedcdb30216 None None] Network e40bb745-7523-4329-91e3-c55442c5a8fa requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:12.832944 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c79c0552-b9cd-4d8d-bd83-a0854fdf3a72 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.844131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.845228 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:12.963202 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Allocated IP 172.27.0.227 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/b804f9d3-4385-4863-8301-b631ae7123e4) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:13.040062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.222941 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c79c0552-b9cd-4d8d-bd83-a0854fdf3a72 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.266949 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c79c0552-b9cd-4d8d-bd83-a0854fdf3a72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.295031 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.324268 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c79c0552-b9cd-4d8d-bd83-a0854fdf3a72 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=718a067247a44b15826e742c795728ac&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7099769 Nov 15 17:48:13.328010 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51246) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:13.332718 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79c0552-b9cd-4d8d-bd83-a0854fdf3a72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bcaa664-16a9-442c-a4f7-81c71b38f062,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:13.409084 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f53107b2-b4c1-4543-bcbc-40ebc64d796c None None] Network c6711a21-f84e-4a09-b311-4dc71011fb84 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:13.443580 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.450364 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.478351 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.546955 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51268) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:13.548313 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.561729 dv-cinder-788366-7-iscsi neutron-server[108141]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 15 17:48:13.583099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:13.606108 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:13.616273 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.622238 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:13.623597 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7bcaa664-16a9-442c-a4f7-81c71b38f062 HTTP/1.1" status: 204 len: 168 time: 0.2945328 Nov 15 17:48:13.624917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:13.667990 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51284) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:13.780622 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3d4a074-c7f8-468f-aeb1-cb512400661a None None] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:13.802354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f96941-9bc7-4a14-b470-654083b46322 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bcaa664-16a9-442c-a4f7-81c71b38f062,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:13.815713 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Pushing event updated for resources: {'Port': ['ID=b804f9d3-4385-4863-8301-b631ae7123e4,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:14.064952 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-e40bb745-7523-4329-91e3-c55442c5a8fa', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:48:14.065843 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.065970 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-ea3ab77d-466b-46f6-9928-a50e20e3a996 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:14.067588 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-ea3ab77d-466b-46f6-9928-a50e20e3a996 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.5158868 Nov 15 17:48:14.113516 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.155786 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6d085d22-b4c8-4780-81c3-2d26521bdd64 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/quotas/cdb494aa542c4eff8e62f9dd653bde82 HTTP/1.1" status: 200 len: 375 time: 0.0536284 Nov 15 17:48:14.245224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51302) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:14.267894 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e637562-669f-4df4-b943-0af861ac25a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.280452 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.295050 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-b203fe4c-9f02-4133-b8d9-1190abd200c5 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1090014 Nov 15 17:48:14.321811 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.331489 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-cbf41aea-c967-47e0-a046-e6be6a58dffa tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:14.333307 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-cbf41aea-c967-47e0-a046-e6be6a58dffa tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/networks?id=c6711a21-f84e-4a09-b311-4dc71011fb84 HTTP/1.1" status: 200 len: 812 time: 0.4765260 Nov 15 17:48:14.355417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Allocated IP 172.20.0.2 (e40bb745-7523-4329-91e3-c55442c5a8fa/ceb6358c-736e-42b9-8a34-e129c4912f6f/2a87eac5-663e-420c-953d-9ce7085ab1c8) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:14.441150 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-433a51d1-8c80-4a5e-b47f-22441f1dfb6f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/quotas/04f55f51f2b5414d837b134a5c85985c HTTP/1.1" status: 200 len: 375 time: 0.0937619 Nov 15 17:48:14.449561 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.466653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e637562-669f-4df4-b943-0af861ac25a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.498645 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-bd66788b-a1d9-4cbd-bdca-6de1e37628b0 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=04f55f51f2b5414d837b134a5c85985c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0565190 Nov 15 17:48:14.503798 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e637562-669f-4df4-b943-0af861ac25a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.557770 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Allocated IP 172.27.0.113 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/4f2826aa-a6d2-4363-87c3-ee772c11656c) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:14.567970 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-83a1cd53-dfc2-4b1a-8c8f-7fa4b0ef2d39 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:48:14.569014 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-83a1cd53-dfc2-4b1a-8c8f-7fa4b0ef2d39 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1114826 Nov 15 17:48:14.577682 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.587839 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.603724 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-7e637562-669f-4df4-b943-0af861ac25a7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a844ba1230cc46588bc1c8a558fc9397&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3571961 Nov 15 17:48:14.605700 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51316) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:14.622298 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e637562-669f-4df4-b943-0af861ac25a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab53e5bd-5e74-4064-991e-217de9c21050,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:14.641313 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Network e40bb745-7523-4329-91e3-c55442c5a8fa is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:14.644464 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:14.665776 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:14.673968 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Pushing event updated for resources: {'Port': ['ID=2a87eac5-663e-420c-953d-9ce7085ab1c8,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:14.702092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.703835 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.704410 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.704899 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.705422 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.705776 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.706102 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.706600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.706921 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.707255 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.707764 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.708082 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.708568 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Tracked resource versions report: Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: pushed versions: Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: { 'AddressGroup': {'1.2'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'ConntrackHelper': {'1.0'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Log': {'1.0'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Network': {'1.1'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Port': {'1.7'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'PortForwarding': {'1.2'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'QosPolicy': {'1.10'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroup': {'1.5'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SubPort': {'1.0'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Subnet': {'1.1'}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Trunk': {'1.1'}} Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: consumer versions: Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: HyperV agent@hv-cinder-78836: {}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'ConntrackHelper': '1.0', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Log': '1.0', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Network': '1.1', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Port': '1.7', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'PortForwarding': '1.2', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'QosPolicy': '1.10', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroup': '1.5', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SecurityGroupRule': '1.2', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'SubPort': '1.0', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Subnet': '1.1', Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: 'Trunk': '1.1'}} Nov 15 17:48:14.709808 dv-cinder-788366-7-iscsi neutron-server[108143]: {{(pid=108143) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:48:14.722494 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:48:14.740360 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.741955 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Attempting to bind port 2a87eac5-663e-420c-953d-9ce7085ab1c8 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:14.742501 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Attempting to bind port 2a87eac5-663e-420c-953d-9ce7085ab1c8 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:14.743082 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Attempting to bind port 2a87eac5-663e-420c-953d-9ce7085ab1c8 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:14.749391 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:14.749747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Checking segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:14.750148 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.750534 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Bound using segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:14.751005 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Bound port: 2a87eac5-663e-420c-953d-9ce7085ab1c8, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:14.751396 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.764005 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-6ec28aa7-1600-47c0-87c8-2362020318b9 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:48:14.773644 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-6ec28aa7-1600-47c0-87c8-2362020318b9 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2035766 Nov 15 17:48:14.821942 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] For port 2a87eac5-663e-420c-953d-9ce7085ab1c8, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:14.825950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] For port 2a87eac5-663e-420c-953d-9ce7085ab1c8, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=2a87eac5-663e-420c-953d-9ce7085ab1c8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:14.830434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.862655 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:48:14.877612 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Sync routers for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:48:14.884661 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.887714 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.895382 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:14.896887 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:14.900116 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ab53e5bd-5e74-4064-991e-217de9c21050 HTTP/1.1" status: 204 len: 168 time: 0.2830925 Nov 15 17:48:14.907906 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2decac31-3ed7-4fc4-ad2c-a9075075cd0b None None] Pushing event updated for resources: {'Port': ['ID=2a87eac5-663e-420c-953d-9ce7085ab1c8,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:14.910745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:14.916623 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-de0f70c5-b99d-485b-9ba3-17209cedde8f admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 3.3133116 Nov 15 17:48:14.918707 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51324) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:14.926504 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb8908d-a1b6-4056-9a55-393ba6e2b204 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab53e5bd-5e74-4064-991e-217de9c21050,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:15.047934 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-b16adcd6-5dc7-4880-a988-76800f9f8255 service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4683492 Nov 15 17:48:15.128211 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-abcc1f1d-9fa8-4dff-9da0-0dd85f38b54a service neutron] 10.222.0.31 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3535953 Nov 15 17:48:15.161442 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:15.170655 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:15.473374 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:13Z', 'revision_number': 3, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:15.519360 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Checking router: bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:48:15.519917 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Updating router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 port b804f9d3-4385-4863-8301-b631ae7123e4 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:48:15.539480 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-87257351-fd18-4b69-8b8e-9b4eff01eb8b service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4906626 Nov 15 17:48:15.553089 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:15.555368 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-b10bac35-3605-4472-8347-bb095a48f682 service neutron] 10.222.0.31 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4260542 Nov 15 17:48:15.653736 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:15.731211 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:15.737747 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:15.740515 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:15.830454 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Pushing event updated for resources: {'Port': ['ID=4f2826aa-a6d2-4363-87c3-ee772c11656c,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:16.260394 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-43ef0077-a2de-4a4d-8060-0f4dd4ad0d20 req-1c5997cc-d04e-4f46-9b44-1dc118c9a07c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.1755035 Nov 15 17:48:16.367298 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0b922640-e302-41f8-b983-d537be391445 req-1abb6d53-b8c7-4cb5-9da5-8c97da5c97e5 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.0873575 Nov 15 17:48:16.368854 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.388676 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.412912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.432923 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.511086 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a95a588f-e27e-46e3-9d48-4bc60bfadf53 None None] Network e40bb745-7523-4329-91e3-c55442c5a8fa requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:16.543927 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Pushing event updated for resources: {'Port': ['ID=b804f9d3-4385-4863-8301-b631ae7123e4,revision_number=2']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:16.564872 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.565227 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.565766 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.566280 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.566815 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.567562 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.568076 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.569219 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.569478 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.569883 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.570234 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.572911 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Tracked resource versions report: Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: pushed versions: Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: { 'AddressGroup': {'1.2'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'ConntrackHelper': {'1.0'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Log': {'1.0'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Network': {'1.1'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Port': {'1.7'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'PortForwarding': {'1.2'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'QosPolicy': {'1.10'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroup': {'1.5'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroupRule': {'1.2'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SubPort': {'1.0'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Subnet': {'1.1'}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Trunk': {'1.1'}} Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: consumer versions: Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: { DHCP agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: HyperV agent@hv-cinder-78836: {}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: L3 agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: Metadata agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: Metering agent@dv-cinder-788366-7-iscsi: {}, Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: Open vSwitch agent@dv-cinder-788366-7-iscsi: { 'AddressGroup': '1.2', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'ConntrackHelper': '1.0', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Log': '1.0', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Network': '1.1', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Port': '1.7', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'PortForwarding': '1.2', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'QosPolicy': '1.10', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroup': '1.5', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SecurityGroupRule': '1.2', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'SubPort': '1.0', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Subnet': '1.1', Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: 'Trunk': '1.1'}} Nov 15 17:48:16.574053 dv-cinder-788366-7-iscsi neutron-server[108144]: {{(pid=108144) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 17:48:16.638256 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Attempting to bind port b804f9d3-4385-4863-8301-b631ae7123e4 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:16.640184 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Attempting to bind port b804f9d3-4385-4863-8301-b631ae7123e4 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:16.640884 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Attempting to bind port b804f9d3-4385-4863-8301-b631ae7123e4 on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:16.667061 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:16.669794 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:16.671512 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.673623 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:16.674191 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Bound port: b804f9d3-4385-4863-8301-b631ae7123e4, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:16.674567 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.798433 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] Provisioning complete for port 2a87eac5-663e-420c-953d-9ce7085ab1c8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:16.798844 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:16.897879 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51422) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:16.916154 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 2a87eac5-663e-420c-953d-9ce7085ab1c8 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:16.918666 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] For port b804f9d3-4385-4863-8301-b631ae7123e4, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:16.924220 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] For port b804f9d3-4385-4863-8301-b631ae7123e4, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b804f9d3-4385-4863-8301-b631ae7123e4,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:16.937252 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.090967 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 2a87eac5-663e-420c-953d-9ce7085ab1c8 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:17.091363 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.102263 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8bdeb3fc-5d4b-439f-ad53-9e5c6715cd82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.116610 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:17.117330 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:17.136117 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34481a70-756b-4122-8566-c454899b9d83 None None] Pushing event updated for resources: {'Port': ['ID=b804f9d3-4385-4863-8301-b631ae7123e4,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:17.146714 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.256144 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8bdeb3fc-5d4b-439f-ad53-9e5c6715cd82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.265158 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] For port 2a87eac5-663e-420c-953d-9ce7085ab1c8, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=2a87eac5-663e-420c-953d-9ce7085ab1c8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:17.270192 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8bdeb3fc-5d4b-439f-ad53-9e5c6715cd82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.283131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Allocated IP 172.20.0.1 (f25d23f6-7f59-4624-979f-a398984b16c9/9b912b7e-3193-418b-9139-60018a571278/dfc39e9f-8c1e-4337-980d-b53e78bac2f2) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:17.332885 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.353884 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.437717 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.443290 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:17.493923 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8bdeb3fc-5d4b-439f-ad53-9e5c6715cd82 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=66e18d5270de4446861564bb520a1e0c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5921392 Nov 15 17:48:17.496253 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51452) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:17.515338 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bdeb3fc-5d4b-439f-ad53-9e5c6715cd82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7542912-adf9-4be1-9b01-26ba2a8fe512,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:17.567904 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6689174a-a3e0-4f04-98b1-7114be4c5932 None None] Pushing event updated for resources: {'Port': ['ID=2a87eac5-663e-420c-953d-9ce7085ab1c8,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:17.625804 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-9c7656b1-cfe4-4c66-8665-96426ebb5c5a None None] Provisioning complete for port 2a87eac5-663e-420c-953d-9ce7085ab1c8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:17.626169 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9c7656b1-cfe4-4c66-8665-96426ebb5c5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.675309 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.721525 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.759308 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.db.api [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108143) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 15 17:48:17.760209 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG oslo_db.api [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 15 17:48:17.794533 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86c93543-31d4-4571-bcc7-db47cf9019f6 req-72652599-72a7-4b2d-8eb6-23560b025a29 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.1216640 Nov 15 17:48:17.806585 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.811173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:17.827729 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c7542912-adf9-4be1-9b01-26ba2a8fe512 HTTP/1.1" status: 204 len: 168 time: 0.3159432 Nov 15 17:48:17.855779 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede80818-6b2e-485c-b932-2d3fce1c48aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7542912-adf9-4be1-9b01-26ba2a8fe512,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:17.919466 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e72a5a6f-b420-41fc-ac28-074aa55902b0 req-4832fbb4-1f1a-47fc-b677-12bd108380e8 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.2476082 Nov 15 17:48:18.012749 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:13Z', 'revision_number': 3, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:18.080527 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:18.110152 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ba432f-309c-4401-b571-08db7d5532d8 None None] The sync data for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi is: [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:13Z', 'revision_number': 3, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:48:18.274666 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:18.416642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Pushing event updated for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:18.463119 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Network f25d23f6-7f59-4624-979f-a398984b16c9 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:18.471713 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:18.475474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:18.475999 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:18.818507 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Router 157002b9-ee54-4569-938f-37ce4b4383a6 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:48:19.006916 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 2a87eac5-663e-420c-953d-9ce7085ab1c8 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:19.176693 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 2a87eac5-663e-420c-953d-9ce7085ab1c8 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:19.176878 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.186539 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.247152 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4ebd5f41-7154-47de-8e13-2934942b4488 req-908f6359-fbac-4100-a8d8-699b9d9c277b tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.0419338 Nov 15 17:48:19.299939 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:48:19.362382 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:48:19.363861 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.365215 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7b537913-9716-460a-92e1-8e5d93ca6fb6 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.5713804 Nov 15 17:48:19.368549 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51554) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:19.439301 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b804f9d3-4385-4863-8301-b631ae7123e4 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:19.458955 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:19.459611 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:19.666213 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.48', 53949) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:19.741382 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b85bdc56-c78d-43c3-ad8d-7c2da1855ecf req-fb47a1d7-2123-4138-ad13-ccd67444fa86 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.1319044 Nov 15 17:48:19.818638 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.831104 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.832474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.889263 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b804f9d3-4385-4863-8301-b631ae7123e4 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:19.891499 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:19.909449 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:20.146032 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Network f25d23f6-7f59-4624-979f-a398984b16c9 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:20.152197 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:20.178906 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Pushing event updated for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:20.342833 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:48:20.399960 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.48', 53954) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:20.873176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:20.977985 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-82fcb160-3ee9-4888-b821-25fe7226a55d req-c8032874-100c-4f9e-b8aa-cc2349b7dc97 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.1074071 Nov 15 17:48:20.981290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port b804f9d3-4385-4863-8301-b631ae7123e4, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b804f9d3-4385-4863-8301-b631ae7123e4,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:20.988289 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:20.997884 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-97fff64e-693a-49d2-812a-29beafd8910f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:21.000761 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-97fff64e-693a-49d2-812a-29beafd8910f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.48 "GET /v2.0/networks?id=c6711a21-f84e-4a09-b311-4dc71011fb84 HTTP/1.1" status: 200 len: 812 time: 1.3336174 Nov 15 17:48:21.026889 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f164f320-b666-4006-821c-f326bc247e1d req-52736841-60f3-483c-9ad5-5335c2b63d8d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.0820143 Nov 15 17:48:21.041829 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-34a09681-2cb7-4d35-a183-fee09470006f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:21.057158 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-34a09681-2cb7-4d35-a183-fee09470006f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.6560123 Nov 15 17:48:21.073867 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Request body: {'port': {'device_id': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84', 'admin_state_up': True, 'tenant_id': '04f55f51f2b5414d837b134a5c85985c'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:21.108380 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:48:21.127735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-557b597a-b43a-4ae9-ac0e-160b47fab44d admin admin] 10.222.0.31 "PUT /v2.0/routers/bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1969671 Nov 15 17:48:21.140048 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:15Z', 'revision_number': 3, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:21.177599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Request body: {'port': {'device_id': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'admin_state_up': True, 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:21.178196 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:48:21.178494 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Updating router 157002b9-ee54-4569-938f-37ce4b4383a6 port 4f2826aa-a6d2-4363-87c3-ee772c11656c binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:48:21.208874 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.211020 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=b804f9d3-4385-4863-8301-b631ae7123e4,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:21.246634 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Sync routers for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:48:21.258978 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:21.259581 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:21.412316 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:21.803034 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.809837 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.826417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.841622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.db.api [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 15 17:48:21.841622 dv-cinder-788366-7-iscsi neutron-server[108142]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 15 17:48:21.841622 dv-cinder-788366-7-iscsi neutron-server[108142]: [parameters: {'project_id': 'cdb494aa542c4eff8e62f9dd653bde82', 'id': 'f48f8d68-2221-44b9-b025-24558afe6938', 'expiration': datetime.datetime(2021, 11, 15, 17, 50, 21, 803989)}] Nov 15 17:48:21.841622 dv-cinder-788366-7-iscsi neutron-server[108142]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=108142) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 15 17:48:21.842892 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG oslo_db.api [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 15 17:48:21.844928 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:18Z', 'revision_number': 4, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dfc39e9f-8c1e-4337-980d-b53e78bac2f2', 'name': '', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'mac_address': 'fa:16:3e:71:e1:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '9b912b7e-3193-418b-9139-60018a571278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:16Z', 'updated_at': '2021-11-15T17:48:19Z', 'revision_number': 2, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'subnets': [{'id': '9b912b7e-3193-418b-9139-60018a571278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:21.880436 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Checking router: bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:48:21.880792 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Updating router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:48:21.910111 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.912795 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Made reservation on behalf of 04f55f51f2b5414d837b134a5c85985c for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:21.917929 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:21.990553 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Attempting to bind port 4f2826aa-a6d2-4363-87c3-ee772c11656c on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:21.991090 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Attempting to bind port 4f2826aa-a6d2-4363-87c3-ee772c11656c by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:21.997434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Attempting to bind port 4f2826aa-a6d2-4363-87c3-ee772c11656c on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:22.012589 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:22.022923 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:22.024053 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.025695 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:22.037885 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Bound port: 4f2826aa-a6d2-4363-87c3-ee772c11656c, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:22.039635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.094905 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-9bcf405a-2a44-4b69-a332-d7a67e4405d4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:22.097420 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-9bcf405a-2a44-4b69-a332-d7a67e4405d4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 819 time: 0.1558359 Nov 15 17:48:22.174319 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f87c28b-6005-405e-aa9f-c34226530601 req-51d975da-6c52-4eec-a8a4-5b6ae3cf5171 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.0636280 Nov 15 17:48:22.175844 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-274d6c19-acd1-446c-95fe-df7900b8c7dd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/quotas/ea39cfbc451d47108eac0fac5c2f4873 HTTP/1.1" status: 200 len: 375 time: 0.0656459 Nov 15 17:48:22.184697 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] For port 4f2826aa-a6d2-4363-87c3-ee772c11656c, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:22.200907 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] For port 4f2826aa-a6d2-4363-87c3-ee772c11656c, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=4f2826aa-a6d2-4363-87c3-ee772c11656c,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:22.204283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51698) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:22.205978 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cba2cd1-f7b0-458c-8d74-d5d2210223ad None None] Pushing event updated for resources: {'Port': ['ID=4f2826aa-a6d2-4363-87c3-ee772c11656c,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:22.217560 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.314750 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-fd54a494-3c83-4582-8c6f-349bfde291cf tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1284988 Nov 15 17:48:22.323141 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cba2cd1-f7b0-458c-8d74-d5d2210223ad None None] Pushing event updated for resources: {'Port': ['ID=4f2826aa-a6d2-4363-87c3-ee772c11656c,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:22.362624 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:22.363354 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:22.433311 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9f433001-bfa3-459a-b6ae-890fc4486361 req-dce181a8-f45f-4ee4-b079-659e9a6cf9a1 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.1247761 Nov 15 17:48:22.473075 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.540397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:22.542973 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-762e4018-50f2-4b75-ab42-2c5a200bf999 service neutron] 10.222.0.31 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2175548 Nov 15 17:48:22.589240 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.596950 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Allocated IP 172.20.0.8 (c6711a21-f84e-4a09-b311-4dc71011fb84/28e89ccf-c78a-4f2e-be95-0646f1dfc889/998a7bad-c8ca-4278-93c2-bc9e99bb6c98) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:22.602157 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.603523 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e21dcd71-bc8e-4618-8344-5ab42401cda9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.642166 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:22.646277 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.711968 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-3c3560a3-271e-4f41-b23d-4d326bc53434 service neutron] 10.222.0.31 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1646435 Nov 15 17:48:22.722518 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcf256a-d6c5-4673-9092-3847aa48b332 None None] Pushing event updated for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:22.897869 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Attempting to bind port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:22.898402 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Attempting to bind port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:22.898934 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Attempting to bind port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 on network f25d23f6-7f59-4624-979f-a398984b16c9 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:22.908844 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:22.909732 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Checking segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:22.910353 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:22.911101 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Bound using segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:22.911868 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Bound port: dfc39e9f-8c1e-4337-980d-b53e78bac2f2, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:22.912704 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.014822 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:15Z', 'revision_number': 3, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:23.058360 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71e92a5f-783d-4b34-b82a-8dbc7cffcad6 req-91cd51b3-0e49-4e52-b3f6-0a75f5887a16 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 210 time: 0.0687797 Nov 15 17:48:23.065453 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] For port dfc39e9f-8c1e-4337-980d-b53e78bac2f2, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:23.074651 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] For port dfc39e9f-8c1e-4337-980d-b53e78bac2f2, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:23.100916 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.139912 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67bf2541-a59c-4e02-9496-3a5e7af7f9f4 None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:15Z', 'revision_number': 3, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:48:23.181172 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b804f9d3-4385-4863-8301-b631ae7123e4 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:23.268587 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e21dcd71-bc8e-4618-8344-5ab42401cda9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.293184 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:23.293930 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:23.338252 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Allocated IP 172.20.0.6 (3919dfc4-3e42-4144-97e7-2ccb5146f2a2/c6a2eeae-0fac-4586-be17-093ae2e28ec5/6eb8cabb-711a-47ac-965c-82db4534f237) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:23.380960 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e21dcd71-bc8e-4618-8344-5ab42401cda9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.411435 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.442141 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b804f9d3-4385-4863-8301-b631ae7123e4 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:23.444900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:23.481096 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a29380c4-2119-4df4-9156-b418c58694cb req-76747969-2ce9-44ec-9f77-e14872b3ba83 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.0626097 Nov 15 17:48:23.571219 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcf256a-d6c5-4673-9092-3847aa48b332 None None] Pushing event updated for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:23.709959 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Allocated IP 172.20.0.1 (e40bb745-7523-4329-91e3-c55442c5a8fa/ceb6358c-736e-42b9-8a34-e129c4912f6f/ff012446-3d0c-4470-b9d0-f62a14c057a8) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:23.710196 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:23.808903 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-edce2080-0181-4923-bc73-af7c6d4b9382 req-2740f9ba-f573-403e-b897-359347f2b02f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.1087749 Nov 15 17:48:23.940257 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-3e46a258-0d83-4ec4-86b0-7f81704959aa tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:23.955251 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-3e46a258-0d83-4ec4-86b0-7f81704959aa tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 819 time: 0.4007413 Nov 15 17:48:23.978656 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-5cb5c375-a90f-4315-8c7e-c7fb04aa36e1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/quotas/ea39cfbc451d47108eac0fac5c2f4873 HTTP/1.1" status: 200 len: 375 time: 0.0219750 Nov 15 17:48:24.028419 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-e21dcd71-bc8e-4618-8344-5ab42401cda9 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9883fa8e240d4b43a8095c50101e552e&name=default HTTP/1.1" status: 200 len: 2992 time: 1.8008814 Nov 15 17:48:24.032282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51740) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:24.045680 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:18Z', 'revision_number': 4, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dfc39e9f-8c1e-4337-980d-b53e78bac2f2', 'name': '', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'mac_address': 'fa:16:3e:71:e1:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '9b912b7e-3193-418b-9139-60018a571278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:16Z', 'updated_at': '2021-11-15T17:48:23Z', 'revision_number': 4, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'subnets': [{'id': '9b912b7e-3193-418b-9139-60018a571278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:24.079075 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f35f895b-7675-4131-a8b8-dc39d8c610f2 None None] The sync data for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi is: [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:48:18Z', 'revision_number': 4, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dfc39e9f-8c1e-4337-980d-b53e78bac2f2', 'name': '', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'mac_address': 'fa:16:3e:71:e1:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '9b912b7e-3193-418b-9139-60018a571278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:16Z', 'updated_at': '2021-11-15T17:48:23Z', 'revision_number': 4, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'subnets': [{'id': '9b912b7e-3193-418b-9139-60018a571278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:48:24.087565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-bff40806-4c38-44a8-899d-67ff334663d3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1077092 Nov 15 17:48:24.113354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.128047 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.132919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21dcd71-bc8e-4618-8344-5ab42401cda9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dabc9b3d-f644-4fe8-9808-72a2a25c5862,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:24.203589 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.252564 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.272143 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-c95c94b5-de3c-4771-9dac-2e76e810cc80 service neutron] 10.222.0.31 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1727457 Nov 15 17:48:24.320656 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Pushing event updated for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:24.392237 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.420089 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-871b9a28-a06a-48a0-bba5-dd4f73e9a667 service neutron] 10.222.0.31 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1404860 Nov 15 17:48:24.442393 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.446169 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Network c6711a21-f84e-4a09-b311-4dc71011fb84 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:24.455856 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.457517 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.461228 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.468534 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/dabc9b3d-f644-4fe8-9808-72a2a25c5862 HTTP/1.1" status: 204 len: 168 time: 0.4329133 Nov 15 17:48:24.474697 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:24.483285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869f4042-4472-478b-be4b-80000f409c78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dabc9b3d-f644-4fe8-9808-72a2a25c5862,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:24.513014 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:24.520187 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:24.521028 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.554890 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-3f05fda4-7b7f-41c9-afe3-74387ed59559 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4823649 Nov 15 17:48:24.562998 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:24.569341 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:24.594228 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Network e40bb745-7523-4329-91e3-c55442c5a8fa is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:24.595660 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:24.627611 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:24.628378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.638045 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:24.654466 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:24.660421 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:24.811563 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39dc02c5-f486-4d41-9011-e612181d83ea req-e65ede14-2dc9-42f4-8de2-fd7477c072a0 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:24.821375 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-39dc02c5-f486-4d41-9011-e612181d83ea req-e65ede14-2dc9-42f4-8de2-fd7477c072a0 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 931 time: 0.1422293 Nov 15 17:48:25.015203 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event updated for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:25.045139 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-39dc02c5-f486-4d41-9011-e612181d83ea req-d2e6b92c-7a92-44a6-9bba-4e25e7c1cede tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2200775 Nov 15 17:48:25.075018 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-05b6d445-8bc2-4dbe-8bb2-aaa5a202191d req-4726d610-c65c-4212-ac8a-543d28982b05 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.1475904 Nov 15 17:48:25.142276 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-635aa20a-7fb7-4500-99fb-eeb4fb7be9b4 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:48:25.143299 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-635aa20a-7fb7-4500-99fb-eeb4fb7be9b4 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0059612 Nov 15 17:48:25.162402 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.212913 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-6814bf56-a1bc-4d9f-98a4-6ada9ab86c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.0411398 Nov 15 17:48:25.332355 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-7b4c4267-4671-4968-81a0-ba4549512402 None None] Provisioning complete for port ff012446-3d0c-4470-b9d0-f62a14c057a8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:25.354868 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7b4c4267-4671-4968-81a0-ba4549512402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.359212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3201001-7d8e-45a3-8421-fdd36124aa24 req-300db719-f440-4340-bab7-4a16cce29153 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:25.369294 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c3201001-7d8e-45a3-8421-fdd36124aa24 req-300db719-f440-4340-bab7-4a16cce29153 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 931 time: 0.1533167 Nov 15 17:48:25.379551 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51770) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:25.379687 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Pushing event updated for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:25.446412 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a79bacf-c1fd-4873-89c1-4faf7bba2413 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.541183 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 4f2826aa-a6d2-4363-87c3-ee772c11656c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:25.665805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-7b4c4267-4671-4968-81a0-ba4549512402 None None] Port ff012446-3d0c-4470-b9d0-f62a14c057a8 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:48:25.718758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 4f2826aa-a6d2-4363-87c3-ee772c11656c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:25.719519 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.895609 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a79bacf-c1fd-4873-89c1-4faf7bba2413 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.933915 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c3201001-7d8e-45a3-8421-fdd36124aa24 req-4ac79877-de93-4827-bc41-249994d2dd49 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5632920 Nov 15 17:48:25.935167 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a79bacf-c1fd-4873-89c1-4faf7bba2413 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:25.971225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.003841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.009757 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Request body: {'port': {'device_id': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:26.046543 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9a79bacf-c1fd-4873-89c1-4faf7bba2413 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b312c8ca2cbc4df99966a324abd06b11&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6711977 Nov 15 17:48:26.058122 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 4f2826aa-a6d2-4363-87c3-ee772c11656c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=4f2826aa-a6d2-4363-87c3-ee772c11656c,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:26.061703 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51796) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:26.065413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.066669 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dfc39e9f-8c1e-4337-980d-b53e78bac2f2 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:26.139756 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.143899 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.206456 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Request body: {'port': {'device_id': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:26.282993 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a79bacf-c1fd-4873-89c1-4faf7bba2413 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc2f17a7-bdac-4d44-adea-27bc2f3bfd6b,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:26.313090 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.48', 53972) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:26.379245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-038c2a61-4d71-461b-b9e5-73dc1acb005a req-91c98ca0-9c61-45b2-ba3a-e866f8428a77 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.1525896 Nov 15 17:48:26.470845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=4f2826aa-a6d2-4363-87c3-ee772c11656c,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:26.540375 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:26.541394 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.578487 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.643614 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.797154 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.802150 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:26.803750 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fc2f17a7-bdac-4d44-adea-27bc2f3bfd6b HTTP/1.1" status: 204 len: 168 time: 0.7398992 Nov 15 17:48:26.836027 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277a17e0-e499-45be-bddf-bfc966045243 req-30b8f1e6-34b2-4bf1-b241-cf37e0e12e14 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:26.851536 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-277a17e0-e499-45be-bddf-bfc966045243 req-30b8f1e6-34b2-4bf1-b241-cf37e0e12e14 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 931 time: 0.5492735 Nov 15 17:48:26.891485 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614e7a52-c856-440e-92fd-c1284b5b23e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc2f17a7-bdac-4d44-adea-27bc2f3bfd6b,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:26.906501 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Pushing event updated for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:27.002440 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-277a17e0-e499-45be-bddf-bfc966045243 req-cf492066-f8d0-4071-b956-91f5e647eef6 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1474566 Nov 15 17:48:27.081959 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.138358 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6caad310-e7fb-471c-81a0-5c22ef869733 req-1c71b19e-943e-4aa5-ab72-02e2ad5a8586 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:27.148320 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6caad310-e7fb-471c-81a0-5c22ef869733 req-1c71b19e-943e-4aa5-ab72-02e2ad5a8586 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 931 time: 0.0849721 Nov 15 17:48:27.153024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51830) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:27.197321 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port dfc39e9f-8c1e-4337-980d-b53e78bac2f2, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:27.214660 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.238861 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6caad310-e7fb-471c-81a0-5c22ef869733 req-d761ba6a-1d2b-4291-92cc-ae8130c1871a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845077 Nov 15 17:48:27.320164 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.333264 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:27.430937 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 4f2826aa-a6d2-4363-87c3-ee772c11656c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:27.528120 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.537243 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6648daee-f2ab-4cc3-8677-9d4b79cbc2d9 req-dede4d00-45d4-4e52-aeac-bada23394610 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.0383227 Nov 15 17:48:27.549704 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9dfcff60-1c1e-4b3f-9c60-a933c7602c70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.585721 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.48', 53979) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:27.587183 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 4f2826aa-a6d2-4363-87c3-ee772c11656c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:27.588252 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.686006 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-f63e5dae-1316-4c9d-ba00-c9bf3779cb5c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:27.695929 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-f63e5dae-1316-4c9d-ba00-c9bf3779cb5c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 819 time: 1.3493311 Nov 15 17:48:27.732343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Request body: {'port': {'device_id': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'admin_state_up': True, 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:27.807802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9dfcff60-1c1e-4b3f-9c60-a933c7602c70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.824048 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-b50fb246-31bf-446c-82d5-f73ce78d466d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:27.825533 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-b50fb246-31bf-446c-82d5-f73ce78d466d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 819 time: 0.2328806 Nov 15 17:48:27.827723 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9dfcff60-1c1e-4b3f-9c60-a933c7602c70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:27.895642 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9dfcff60-1c1e-4b3f-9c60-a933c7602c70 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e3eb609903d84f20930c2cb4c526da1e&name=default HTTP/1.1" status: 200 len: 2994 time: 0.7179163 Nov 15 17:48:27.896365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dfcff60-1c1e-4b3f-9c60-a933c7602c70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7812b3d6-cec2-40ac-a6f4-f13b7101d904,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:27.899214 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51850) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:27.911688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Request body: {'port': {'device_id': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'admin_state_up': True, 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:27.979368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Network e40bb745-7523-4329-91e3-c55442c5a8fa is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:28.113041 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:28.168436 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:28.419020 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:28.747943 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1989f4d8-1dbc-4061-b93b-c5c07ea9691b req-e209e959-549e-4080-843f-0b87364aa389 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:28.756255 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1989f4d8-1dbc-4061-b93b-c5c07ea9691b req-e209e959-549e-4080-843f-0b87364aa389 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 931 time: 0.5968478 Nov 15 17:48:28.815231 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Made reservation on behalf of ea39cfbc451d47108eac0fac5c2f4873 for: {'port': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:28.822537 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:28.908645 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-fa910d70-1ffe-4609-86c6-94bc3e0c0d09 None None] Provisioning complete for port ff012446-3d0c-4470-b9d0-f62a14c057a8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:28.909285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa910d70-1ffe-4609-86c6-94bc3e0c0d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.055902 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Made reservation on behalf of ea39cfbc451d47108eac0fac5c2f4873 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:29.059317 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.064294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:29.099217 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.198174 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Allocated IP 172.20.0.5 (f25d23f6-7f59-4624-979f-a398984b16c9/9b912b7e-3193-418b-9139-60018a571278/0e458b3e-0cc6-4756-a46f-7648dc4c8384) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:29.206522 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Transition to ACTIVE for port object 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:48:29.230805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-fa910d70-1ffe-4609-86c6-94bc3e0c0d09 None None] Port ff012446-3d0c-4470-b9d0-f62a14c057a8 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:48:29.255544 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:48:29.258468 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.334014 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dfc39e9f-8c1e-4337-980d-b53e78bac2f2 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:29.436016 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:29.436602 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.471834 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1989f4d8-1dbc-4061-b93b-c5c07ea9691b req-b81e0c3b-400e-470c-a8e1-f55f43fdfad7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7147727 Nov 15 17:48:29.486223 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8d01b8-61b1-441c-bbda-386e754e7911 req-19748f42-fa51-4f4e-93dd-4c4639b55e23 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:29.504371 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5b8d01b8-61b1-441c-bbda-386e754e7911 req-19748f42-fa51-4f4e-93dd-4c4639b55e23 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 931 time: 0.8212237 Nov 15 17:48:29.584388 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.590022 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.591799 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7812b3d6-cec2-40ac-a6f4-f13b7101d904 HTTP/1.1" status: 204 len: 168 time: 1.6915216 Nov 15 17:48:29.609753 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df130f3-0673-48ab-b229-258e9950527b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7812b3d6-cec2-40ac-a6f4-f13b7101d904,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:29.669178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Pushing event updated for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:29.683281 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5b8d01b8-61b1-441c-bbda-386e754e7911 req-d5a813ca-c048-4ef6-92aa-5b4a2a936899 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1775510 Nov 15 17:48:29.748462 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Attempting to bind port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:29.749098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Attempting to bind port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:29.749586 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Attempting to bind port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 on network c6711a21-f84e-4a09-b311-4dc71011fb84 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:29.774956 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 on network c6711a21-f84e-4a09-b311-4dc71011fb84 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:48:29.775588 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Attempting to bind port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 on network c6711a21-f84e-4a09-b311-4dc71011fb84 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:29.789313 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.815624 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:29.816573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Checking segment: {'id': 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:29.817514 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Bound using segment: {'id': 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:29.826729 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Bound port: 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:29.827139 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.868851 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:48:29.878192 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-2d4156d8-0c75-4323-a93c-5361a58240df admin admin] 10.222.0.31 "PUT /v2.0/routers/157002b9-ee54-4569-938f-37ce4b4383a6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.5073421 Nov 15 17:48:29.903143 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-977cdfa2-6df9-47e2-b29a-5897bfeee3cb req-82cb3cb4-4d59-4dd8-8e50-df7686589bef tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.1492436 Nov 15 17:48:29.906465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:48:29.924004 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6eb8cabb-711a-47ac-965c-82db4534f237 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:29.942565 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:29.972740 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:29.974030 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:30.010688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.144854 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Allocated IP 172.20.0.11 (f25d23f6-7f59-4624-979f-a398984b16c9/9b912b7e-3193-418b-9139-60018a571278/83d5ff18-1a58-411f-945c-9a39c617ae50) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:30.200382 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Network f25d23f6-7f59-4624-979f-a398984b16c9 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:30.221069 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:30.246856 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:30.258180 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:30.269561 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:30.281249 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.285678 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Pushing event updated for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:30.331153 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-db6d1dbc-f1d0-4ecc-8524-eafc38c3ec49 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4249802 Nov 15 17:48:30.347961 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Transition to ACTIVE for port object 6eb8cabb-711a-47ac-965c-82db4534f237 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:48:30.485555 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:30.493601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,segment=NetworkSegment(c9c85cd9-2596-49ad-ac18-9a7fdef83b16),segment_id=c9c85cd9-2596-49ad-ac18-9a7fdef83b16)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:30.496054 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.522504 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:25Z', 'revision_number': 2, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:30.529886 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.588630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:30.589280 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.598015 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] 10.222.0.48 "PUT /v2.0/ports/998a7bad-c8ca-4278-93c2-bc9e99bb6c98 HTTP/1.1" status: 200 len: 1093 time: 4.9793921 Nov 15 17:48:30.604087 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:30.610196 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:48:30.615606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Updating router 157002b9-ee54-4569-938f-37ce4b4383a6 port ff012446-3d0c-4470-b9d0-f62a14c057a8 binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:48:30.654505 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.677173 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Request body: {'port': {'device_id': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:30.836021 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a29611-5c12-4d3f-a478-a053c9ed0143 req-3aa8c4b1-45a9-4b47-b1e8-e99ba119dbc9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:30.837486 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d8a29611-5c12-4d3f-a478-a053c9ed0143 req-3aa8c4b1-45a9-4b47-b1e8-e99ba119dbc9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.2275946 Nov 15 17:48:30.877950 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 51944) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:30.912581 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:30.948489 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.122311 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0900437e-40ad-4de9-8d67-9dc00f12118c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.125964 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.313687 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d8a29611-5c12-4d3f-a478-a053c9ed0143 req-c3ad9b42-5490-4440-b01d-dfc7f4b93b4c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4366624 Nov 15 17:48:31.555215 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.569417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.587650 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Pushing event updated for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:31.729921 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01076191-7790-4984-957a-1b043c52d4a7" -d '{"events": [{"name": "network-changed", "server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:31.734378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036ec118-9cb8-496a-9277-3ae201e60e05 service neutron] Pushing event updated for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:31.739146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43c89ab9-2599-4ebd-9958-4fac70bbb67b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.829117 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcc83b8-7855-4592-9f54-b28ea5884620 None None] Pushing event updated for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:31.918969 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Attempting to bind port ff012446-3d0c-4470-b9d0-f62a14c057a8 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:31.920101 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Attempting to bind port ff012446-3d0c-4470-b9d0-f62a14c057a8 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:31.923668 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Attempting to bind port ff012446-3d0c-4470-b9d0-f62a14c057a8 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:31.956211 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Network f25d23f6-7f59-4624-979f-a398984b16c9 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:31.961144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:31.961664 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Checking segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:31.962660 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:31.963776 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Bound using segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:31.967598 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Bound port: ff012446-3d0c-4470-b9d0-f62a14c057a8, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:31.968330 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.005380 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Pushing event updated for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:32.029286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 51988) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:32.060909 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1373938000', 'description': 'tempest-description--1493120505'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:32.156178 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] For port ff012446-3d0c-4470-b9d0-f62a14c057a8, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:32.167076 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] For port ff012446-3d0c-4470-b9d0-f62a14c057a8, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=ff012446-3d0c-4470-b9d0-f62a14c057a8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:32.178222 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.179191 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:32.188854 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:32.219941 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:32.220763 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.255029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-c7f8bebc-3b75-4970-9a97-6e54ced34919 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:32.256627 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-c7f8bebc-3b75-4970-9a97-6e54ced34919 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=04f55f51f2b5414d837b134a5c85985c&device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 1096 time: 1.3930469 Nov 15 17:48:32.263785 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Attempting to bind port 6eb8cabb-711a-47ac-965c-82db4534f237 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:32.264114 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Attempting to bind port 6eb8cabb-711a-47ac-965c-82db4534f237 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:32.265983 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Attempting to bind port 6eb8cabb-711a-47ac-965c-82db4534f237 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:32.270745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.326816 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] Provisioning complete for port ff012446-3d0c-4470-b9d0-f62a14c057a8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:32.328341 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.371321 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Port 6eb8cabb-711a-47ac-965c-82db4534f237 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:48:32.372260 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Attempting to bind port 6eb8cabb-711a-47ac-965c-82db4534f237 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:32.377685 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-06b1e2e4-2ea0-46d2-9876-cfa9487c95b7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.6557827 Nov 15 17:48:32.426057 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:48:32.426910 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:48:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:32.510046 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e458b3e-0cc6-4756-a46f-7648dc4c8384 {{(pid=108141) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:32.534223 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.539328 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcc83b8-7855-4592-9f54-b28ea5884620 None None] Pushing event updated for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:32.585123 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.provisioning_blocks [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Transition to ACTIVE for port object 0e458b3e-0cc6-4756-a46f-7648dc4c8384 will not be triggered until provisioned by entity L2. {{(pid=108141) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:48:32.593852 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Request body: {'port': {'device_id': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:32.609670 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.668485 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137e3af1-55cc-41f8-b610-02e9df7db900 req-0a2e4536-2a58-4a91-a18f-8b454bcd36e4 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:32.671232 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-79f30739-6006-49b9-b8a4-6951adad2e23 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98 HTTP/1.1" status: 200 len: 217 time: 0.3436387 Nov 15 17:48:32.676079 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:32.676079 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Checking segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:32.676079 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Bound using segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:32.676079 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Bound port: 6eb8cabb-711a-47ac-965c-82db4534f237, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:32.677043 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-137e3af1-55cc-41f8-b610-02e9df7db900 req-0a2e4536-2a58-4a91-a18f-8b454bcd36e4 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 943 time: 1.0446424 Nov 15 17:48:32.681793 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.720305 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:32.858577 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] For port ff012446-3d0c-4470-b9d0-f62a14c057a8, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=ff012446-3d0c-4470-b9d0-f62a14c057a8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:32.903173 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:48:32.941378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.005353 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.091026 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.105215 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-738a74ab-2b0b-474e-824c-84a01c7910b7 None None] Pushing event updated for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:33.113108 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b3d29f-16e3-4800-9351-c804eb95667b req-0e47ae75-6d06-4615-b785-8c931af2729a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:33.129113 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a7b3d29f-16e3-4800-9351-c804eb95667b req-0e47ae75-6d06-4615-b785-8c931af2729a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 943 time: 0.5277913 Nov 15 17:48:33.138831 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-8e707cbe-52d6-4b60-872d-b48b7ae14299 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:33.143985 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-8e707cbe-52d6-4b60-872d-b48b7ae14299 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=28e89ccf-c78a-4f2e-be95-0646f1dfc889 HTTP/1.1" status: 200 len: 852 time: 0.4206676 Nov 15 17:48:33.154308 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:33.163543 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6eb8cabb-711a-47ac-965c-82db4534f237,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:33.179506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.199087 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Pushing event updated for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:33.255942 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-137e3af1-55cc-41f8-b610-02e9df7db900 req-64869974-2b50-4d8c-9a03-d796a4b71d2e tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4934659 Nov 15 17:48:33.292420 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.371820 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.managers [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Attempting to bind port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:33.371820 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.managers [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Attempting to bind port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}] {{(pid=108141) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:33.371820 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Attempting to bind port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 on network f25d23f6-7f59-4624-979f-a398984b16c9 {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:33.401880 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4763e2ec-c45b-467d-b585-24d2e073d880,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:33.408444 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43c89ab9-2599-4ebd-9958-4fac70bbb67b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.424416 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-938688c3-9abe-40b3-bf01-0d34d64e7f9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.442240 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-10a8759e-0801-47dc-827f-7a86b45efffc None None] Provisioning complete for port ff012446-3d0c-4470-b9d0-f62a14c057a8 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:33.443077 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-10a8759e-0801-47dc-827f-7a86b45efffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.480362 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43c89ab9-2599-4ebd-9958-4fac70bbb67b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.481721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.484807 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-64a9fa67-c30d-4d41-a645-56a780468daf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.4389968 Nov 15 17:48:33.488128 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:33.488949 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.491039 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] 10.222.0.48 "PUT /v2.0/ports/6eb8cabb-711a-47ac-965c-82db4534f237 HTTP/1.1" status: 200 len: 1093 time: 7.8705342 Nov 15 17:48:33.509984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52038) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:33.524311 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-181a4265-304e-46e9-bd55-3beb93be75e9 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c6711a21-f84e-4a09-b311-4dc71011fb84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2984335 Nov 15 17:48:33.552503 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group_rule': {'security_group_id': '4763e2ec-c45b-467d-b585-24d2e073d880', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:33.577193 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 on network f25d23f6-7f59-4624-979f-a398984b16c9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:48:33.577546 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Attempting to bind port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 on network f25d23f6-7f59-4624-979f-a398984b16c9 {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:33.758117 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a7b3d29f-16e3-4800-9351-c804eb95667b req-24f0ce7f-73eb-498b-8379-227cb4e27e14 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6260192 Nov 15 17:48:33.845646 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:33.846158 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Checking segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:33.848595 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Bound using segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} {{(pid=108141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:33.849220 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.managers [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Bound port: 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}}] {{(pid=108141) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:33.849777 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:33.864898 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-43c89ab9-2599-4ebd-9958-4fac70bbb67b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6be9007f178e419c8e0c02dd5d3da7cf&name=default HTTP/1.1" status: 200 len: 2996 time: 2.9803023 Nov 15 17:48:33.873736 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52054) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:33.914930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43c89ab9-2599-4ebd-9958-4fac70bbb67b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a6b563a-bd41-4a13-874d-f19da3830113,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:33.990898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.041145 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.056372 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52058) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:34.060623 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.128291 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:34.194046 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8ccfee5-c825-4a17-912f-73d1652e3ff7 None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:48:34.272124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.332589 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84296d35-9ace-441d-ad47-ff48ec1d29a1 req-b38f694d-b1b3-4ca4-9727-db23fd18e285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:34.351654 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-84296d35-9ace-441d-ad47-ff48ec1d29a1 req-b38f694d-b1b3-4ca4-9727-db23fd18e285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.3664956 Nov 15 17:48:34.401015 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.401347 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-ccc38654-2093-4c55-8bb3-28029858443b service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7438366 Nov 15 17:48:34.406587 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, cleared binding levels {{(pid=108141) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:34.445984 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.447104 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64b2c3d5-7b55-4524-aa49-361992021987 x-openstack-request-id: req-64b2c3d5-7b55-4524-aa49-361992021987 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:34.447579 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:34.447835 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-64b2c3d5-7b55-4524-aa49-361992021987 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:34.448273 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98', 'status': 'completed', 'code': 200} Nov 15 17:48:34.591872 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52072) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:34.641951 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-dd7c73e8-e669-4326-b020-e5afab146117 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:34.643994 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-dd7c73e8-e669-4326-b020-e5afab146117 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 1096 time: 0.2002447 Nov 15 17:48:34.700012 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6dde8bba-b5a5-4681-9fa8-27e1f798a38c,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:34.763248 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108141) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:34.795882 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-7e0e8f2f-93cf-469f-9849-e2b6d56070a2 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6eb8cabb-711a-47ac-965c-82db4534f237 HTTP/1.1" status: 200 len: 217 time: 0.1262178 Nov 15 17:48:34.797389 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0411da7e-a6af-4dda-b423-9c9cc24ac08b service neutron] Pushing event updated for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:34.808043 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-84296d35-9ace-441d-ad47-ff48ec1d29a1 req-c9ebcd7e-982c-4c62-8146-963aa0bf31fd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4502347 Nov 15 17:48:34.808797 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.815687 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.820052 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/6a6b563a-bd41-4a13-874d-f19da3830113 HTTP/1.1" status: 204 len: 168 time: 0.9423158 Nov 15 17:48:34.905123 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6c814dc-aeb8-409f-a0d6-5b893608f44f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.908277 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-ad3ff9d8-9292-4338-a474-d89a71fb842b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:34.917428 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-ad3ff9d8-9292-4338-a474-d89a71fb842b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0862353 Nov 15 17:48:34.927116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712557d5-1084-42d2-bcdf-95ec598f539f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a6b563a-bd41-4a13-874d-f19da3830113,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:34.943163 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.951499 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-56bc6a5a-892d-417c-af98-a242cb7fdd1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.4283190 Nov 15 17:48:34.952955 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:34.971034 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52084) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:35.017297 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-3783d661-d411-4f8b-8cf7-e327cd7f7f1c service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0632701 Nov 15 17:48:35.020352 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group_rule': {'security_group_id': '4763e2ec-c45b-467d-b585-24d2e073d880', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:35.048484 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-bce8e218-dcfb-4441-8c5e-3364ffdc619b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.117026 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Pushing event updated for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=3']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:35.126029 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:35.127386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.131528 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-fa6e9cf2-7cf0-40ea-a592-cc14566d4caf service neutron] 10.222.0.48 "PUT /v2.0/ports/0e458b3e-0cc6-4756-a46f-7648dc4c8384 HTTP/1.1" status: 200 len: 1093 time: 4.4844625 Nov 15 17:48:35.156392 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-bce8e218-dcfb-4441-8c5e-3364ffdc619b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.166450 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:35.176107 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f368916-8bec-4918-9b06-d6b1610771b8 req-e5ed92f8-bfc0-488e-a190-b85a94fc22c4 service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6914799 Nov 15 17:48:35.210140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-bce8e218-dcfb-4441-8c5e-3364ffdc619b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.273686 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-bce8e218-dcfb-4441-8c5e-3364ffdc619b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e15e424f5b604aecb031aa6da622c734&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6733472 Nov 15 17:48:35.337751 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52090) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:35.381920 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6dd332-3f60-4902-b596-84fcade416ca req-62ec24dc-224c-4f63-8e08-088e1f7a5c68 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:35.398874 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f6dd332-3f60-4902-b596-84fcade416ca req-62ec24dc-224c-4f63-8e08-088e1f7a5c68 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 943 time: 0.9413209 Nov 15 17:48:35.531811 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device ff012446-3d0c-4470-b9d0-f62a14c057a8 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:35.615579 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f" -d '{"events": [{"name": "network-changed", "server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:35.622569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce8e218-dcfb-4441-8c5e-3364ffdc619b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a97830a-8239-4d10-a533-b26634d1928a,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:35.650362 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.732129 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-50932d9f-e4fc-4dd1-9296-4f5d3c58648a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:35.733724 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-50932d9f-e4fc-4dd1-9296-4f5d3c58648a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 1096 time: 0.3783298 Nov 15 17:48:35.736153 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port ff012446-3d0c-4470-b9d0-f62a14c057a8 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:35.738125 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.745631 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dffe70f-3488-428b-a718-b65bdfed7c07 req-82a4c0c8-5a54-4eff-badf-82f851af7823 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:35.761922 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3dffe70f-3488-428b-a718-b65bdfed7c07 req-82a4c0c8-5a54-4eff-badf-82f851af7823 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 943 time: 0.7804816 Nov 15 17:48:35.793063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.888713 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52110) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:35.890793 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-261e62ee-6fd0-450c-b55a-0d778fb8ba67 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384 HTTP/1.1" status: 200 len: 217 time: 0.1290662 Nov 15 17:48:35.914282 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f6dd332-3f60-4902-b596-84fcade416ca req-a327142c-6bd0-4779-a579-f4a073ce4d36 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4310284 Nov 15 17:48:35.924657 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01076191-7790-4984-957a-1b043c52d4a7 req-ca8617b9-8e53-4df7-9f8f-5adfa466a9c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:35.926310 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-ca8617b9-8e53-4df7-9f8f-5adfa466a9c0 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=04f55f51f2b5414d837b134a5c85985c&device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 1096 time: 0.4144189 Nov 15 17:48:35.943892 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6c814dc-aeb8-409f-a0d6-5b893608f44f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.945267 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.950234 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a60bff3-2cfb-46f7-a01a-bcb2d9a0776a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:35.978000 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6c814dc-aeb8-409f-a0d6-5b893608f44f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.009892 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 83d5ff18-1a58-411f-945c-9a39c617ae50 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:36.016416 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-25a70cc5-9d60-4a43-8c56-9eac2a709466 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8532646 Nov 15 17:48:36.027037 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.040381 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3dffe70f-3488-428b-a718-b65bdfed7c07 req-8fa3734b-5d90-401d-8ab6-f01df97b59a7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2768841 Nov 15 17:48:36.080326 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Transition to ACTIVE for port object 83d5ff18-1a58-411f-945c-9a39c617ae50 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:48:36.117624 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.150767 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c814dc-aeb8-409f-a0d6-5b893608f44f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84d8ea98-e318-4db3-81f1-f5bf98df4927,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:36.169854 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d6c814dc-aeb8-409f-a0d6-5b893608f44f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=3f1ec1c94ed544e09b53a7df42bf4ace&name=default HTTP/1.1" status: 200 len: 2996 time: 2.0708892 Nov 15 17:48:36.170456 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52114) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:36.233919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-cc2e66cb-575f-458f-9a30-1482149180d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:36.242406 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-cc2e66cb-575f-458f-9a30-1482149180d0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.1654968 Nov 15 17:48:36.248156 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.272274 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.292357 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.417505 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52118) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:36.451393 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:36.451921 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1546f04e-43ce-4cef-929b-fefb5757ce4d x-openstack-request-id: req-1546f04e-43ce-4cef-929b-fefb5757ce4d {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:36.452216 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:36.452752 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1546f04e-43ce-4cef-929b-fefb5757ce4d {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:36.453066 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384', 'status': 'completed', 'code': 200} Nov 15 17:48:36.453817 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2dc8983-ca37-4c83-9f13-db0436001175" -d '{"events": [{"name": "network-changed", "server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:36.480517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.481768 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4671621 Nov 15 17:48:36.482469 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f8f87c-8e4a-4a74-9e51-0d892874aa35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bda1f2c2-29d4-4be6-a40f-cdf7a092f5f2,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:36.489424 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.490294 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-5606727e-df02-4909-ac82-1a97de80b523 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2106311 Nov 15 17:48:36.492254 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.493481 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/6a97830a-8239-4d10-a533-b26634d1928a HTTP/1.1" status: 204 len: 168 time: 1.0863588 Nov 15 17:48:36.496281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52124) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:36.528495 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:36.541189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Pushing event updated for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:36.580208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6c0f63e-307c-4917-ad12-230cca6e2934 x-openstack-request-id: req-a6c0f63e-307c-4917-ad12-230cca6e2934 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:36.580730 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:36.580730 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a6c0f63e-307c-4917-ad12-230cca6e2934 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:36.581096 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237', 'status': 'completed', 'code': 200} Nov 15 17:48:36.603977 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Attempting to bind port 83d5ff18-1a58-411f-945c-9a39c617ae50 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:36.604311 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Attempting to bind port 83d5ff18-1a58-411f-945c-9a39c617ae50 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:36.604685 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Attempting to bind port 83d5ff18-1a58-411f-945c-9a39c617ae50 on network f25d23f6-7f59-4624-979f-a398984b16c9 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:36.606703 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df934c1-8686-408b-aed1-e2c4a40299e7 req-b8c5675d-929a-48fb-86d1-3d1d855089ab tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:36.615428 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1d31ad6c-fdfb-4401-bcef-b07b81c9d4fd req-39dd8326-7c8b-4b09-8854-32b286ec1b48 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3641949 Nov 15 17:48:36.615615 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9df934c1-8686-408b-aed1-e2c4a40299e7 req-b8c5675d-929a-48fb-86d1-3d1d855089ab tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.3916974 Nov 15 17:48:36.616293 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Port 83d5ff18-1a58-411f-945c-9a39c617ae50 on network f25d23f6-7f59-4624-979f-a398984b16c9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:48:36.616612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Attempting to bind port 83d5ff18-1a58-411f-945c-9a39c617ae50 on network f25d23f6-7f59-4624-979f-a398984b16c9 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:36.617620 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d9f169-94bf-4c5b-aba9-d843bf284b66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a97830a-8239-4d10-a533-b26634d1928a,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:36.622872 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:36.623368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Checking segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:36.623550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Bound using segment: {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:36.623980 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Bound port: 83d5ff18-1a58-411f-945c-9a39c617ae50, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b562ff7b-8aea-4e14-99e1-0c669a0cb625', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:36.624331 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.671072 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.676533 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a60bff3-2cfb-46f7-a01a-bcb2d9a0776a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.677540 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.716984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a60bff3-2cfb-46f7-a01a-bcb2d9a0776a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.739921 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.742980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01076191-7790-4984-957a-1b043c52d4a7 req-880e5a3a-2fe2-42c1-8202-60e75830c018 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:36.744838 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-880e5a3a-2fe2-42c1-8202-60e75830c018 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c6711a21-f84e-4a09-b311-4dc71011fb84 HTTP/1.1" status: 200 len: 913 time: 0.5378914 Nov 15 17:48:36.753232 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-41ae3637-ff82-4dca-a2f1-710bbf7f5bc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.784126 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.809458 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:36.815524 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=83d5ff18-1a58-411f-945c-9a39c617ae50,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:36.827970 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.830827 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-78c1bbc2-d3a7-43f6-870d-74bc59d8ad5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:36.832373 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-78c1bbc2-d3a7-43f6-870d-74bc59d8ad5f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 1096 time: 0.0938945 Nov 15 17:48:36.872589 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-71e11760-419a-4286-a7d0-88243a626db9 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2064357 Nov 15 17:48:36.893193 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52132) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:36.916300 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:36.916953 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:36.918357 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] 10.222.0.48 "PUT /v2.0/ports/83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 1094 time: 4.3428993 Nov 15 17:48:36.924715 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3a60bff3-2cfb-46f7-a01a-bcb2d9a0776a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=71756e24c9ca41dfb864b92ef4ef1629&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0264459 Nov 15 17:48:36.926355 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52134) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:36.947164 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-9efe1561-b4fd-4b5c-b224-84471d3d959e service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98 HTTP/1.1" status: 200 len: 217 time: 0.1858695 Nov 15 17:48:37.015390 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9df934c1-8686-408b-aed1-e2c4a40299e7 req-be9a2411-2483-4b13-b345-016af4f81eff tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3989305 Nov 15 17:48:37.015980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a60bff3-2cfb-46f7-a01a-bcb2d9a0776a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6259b2c-088e-4c3a-8c92-b926bfd9ff7e,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.081200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-faf916c0-6c22-41e2-a18d-b2c8b6569c7c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.137937 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75a75b7-d473-4ad5-a781-0deb2005e1ac service neutron] Pushing event updated for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.166898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01076191-7790-4984-957a-1b043c52d4a7 req-fd415750-3bca-4cc5-9e51-0d871ec0e733 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.168372 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-fd415750-3bca-4cc5-9e51-0d871ec0e733 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=28e89ccf-c78a-4f2e-be95-0646f1dfc889 HTTP/1.1" status: 200 len: 852 time: 0.1940606 Nov 15 17:48:37.232289 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.234028 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.236553 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.237716 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/84d8ea98-e318-4db3-81f1-f5bf98df4927 HTTP/1.1" status: 204 len: 168 time: 1.0410342 Nov 15 17:48:37.312039 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-41ae3637-ff82-4dca-a2f1-710bbf7f5bc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.318267 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-ee32a8b1-ce00-4887-8788-09c10eb5c12a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c6711a21-f84e-4a09-b311-4dc71011fb84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1395669 Nov 15 17:48:37.340077 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b64846e-5522-4340-bc73-81ab930f4060 req-765822d4-a755-40b2-a0f4-bfc8ba0a3593 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.341702 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b64846e-5522-4340-bc73-81ab930f4060 req-765822d4-a755-40b2-a0f4-bfc8ba0a3593 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 943 time: 0.2952147 Nov 15 17:48:37.346881 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-41ae3637-ff82-4dca-a2f1-710bbf7f5bc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.364539 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f74d594f-3073-462b-aaac-5c2a3d91329b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84d8ea98-e318-4db3-81f1-f5bf98df4927,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.366386 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-1239e857-5022-43ec-a68a-6fcb7d98946a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.368119 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-1239e857-5022-43ec-a68a-6fcb7d98946a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1097 time: 0.3573020 Nov 15 17:48:37.400137 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-ca401901-cae7-44a6-ad22-98865d289f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.401700 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-ca401901-cae7-44a6-ad22-98865d289f17 service neutron] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 916 time: 0.5334690 Nov 15 17:48:37.415306 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.441336 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-c0512956-4710-4d7c-8323-1b2c3b50ed90 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0606129 Nov 15 17:48:37.443173 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-c0e32729-7bfc-4fa5-8551-cd0411c98162 req-d4beb2ee-3c93-4893-920d-d2ec5e09331f service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5590329 Nov 15 17:48:37.445122 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d38428-3d89-4582-b734-a49e33286f6d req-ac249c27-dabe-41ec-8bd2-a0826cad1863 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.446737 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-25d38428-3d89-4582-b734-a49e33286f6d req-ac249c27-dabe-41ec-8bd2-a0826cad1863 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 943 time: 0.3387907 Nov 15 17:48:37.514042 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-f8786bf9-07b7-4405-b572-d21d36116840 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6eb8cabb-711a-47ac-965c-82db4534f237 HTTP/1.1" status: 200 len: 217 time: 0.0767605 Nov 15 17:48:37.520854 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-41ae3637-ff82-4dca-a2f1-710bbf7f5bc5 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9d81af3d19ad44df9d2530f69ffbb011&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0981469 Nov 15 17:48:37.532957 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52144) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:37.572762 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ae3637-ff82-4dca-a2f1-710bbf7f5bc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ce34d80-657b-46d9-a3ec-1ab10ae53881,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.636494 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52146) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:37.641558 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918621e7-391c-42e5-b246-206d2a246edb req-93f33707-107a-45ef-84ba-1e35e495d9e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.643567 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-93f33707-107a-45ef-84ba-1e35e495d9e0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.1893394 Nov 15 17:48:37.677036 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.681714 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b64846e-5522-4340-bc73-81ab930f4060 req-dde423ef-3c4c-486a-81f7-a9637aba317d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3153348 Nov 15 17:48:37.682256 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-fa40e779-66bd-4ab6-af52-8b36c582df0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.683722 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-fa40e779-66bd-4ab6-af52-8b36c582df0c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.1498930 Nov 15 17:48:37.706698 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4bd1203a-d3c4-44f7-a1fa-5e3ee1c63f09 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.710405 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.711626 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-adf319a7-c90c-479b-b189-a10d7336ee7b service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0463281 Nov 15 17:48:37.713138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.714343 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/a6259b2c-088e-4c3a-8c92-b926bfd9ff7e HTTP/1.1" status: 204 len: 168 time: 0.7693605 Nov 15 17:48:37.721149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-faf916c0-6c22-41e2-a18d-b2c8b6569c7c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.723407 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-936e8143-cf1e-4a6b-a86b-94fb63967771 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:37.724215 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-25d38428-3d89-4582-b734-a49e33286f6d req-8b3429c9-8fad-4320-984f-58a021ca11da tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2081499 Nov 15 17:48:37.725205 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-936e8143-cf1e-4a6b-a86b-94fb63967771 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 1096 time: 0.2146597 Nov 15 17:48:37.763820 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-faf916c0-6c22-41e2-a18d-b2c8b6569c7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.767582 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-0a725878-6af9-44a6-b229-04201b3cf026 service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4217751 Nov 15 17:48:37.779655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15478228-3986-4c3a-a576-c456a35f06ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6259b2c-088e-4c3a-8c92-b926bfd9ff7e,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.796665 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-254c658e-9262-42a6-af94-c495c881429e service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0945504 Nov 15 17:48:37.891111 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:37.965296 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-faf916c0-6c22-41e2-a18d-b2c8b6569c7c admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cc59163ab0a940e393c58673189826a2&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0459278 Nov 15 17:48:37.966129 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf916c0-6c22-41e2-a18d-b2c8b6569c7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05705cbd-2677-41d8-b16b-9966b3258004,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:37.970856 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52152) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:38.018654 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.122583 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-158881ea-f455-4c69-b983-5a49d330b5e5 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3932281 Nov 15 17:48:38.145446 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Allocated IP 172.27.0.223 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/239541d0-8ab6-4c43-b1ad-aa695f376731) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:38.150400 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-c1dc5f9d-cbcf-46b5-8660-3413c38e4965 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:38.152078 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-c1dc5f9d-cbcf-46b5-8660-3413c38e4965 service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.3893661 Nov 15 17:48:38.178155 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-da1354d5-45c8-4114-bf95-01b841c6af25 service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3996837 Nov 15 17:48:38.215054 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4bd1203a-d3c4-44f7-a1fa-5e3ee1c63f09 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.246921 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4bd1203a-d3c4-44f7-a1fa-5e3ee1c63f09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.248579 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.251638 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-7493a988-3143-4e8d-89bc-5bd0517f66ff service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4021204 Nov 15 17:48:38.260850 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-f79dc3c0-857b-4f56-ba5d-2ab40b6b4a0b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384 HTTP/1.1" status: 200 len: 217 time: 0.1002305 Nov 15 17:48:38.274613 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ceddf6e-1707-4321-b098-43573e63e37e req-5b924b2d-e73c-4f5b-ab2c-287c3b27f8c8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:38.276184 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0ceddf6e-1707-4321-b098-43573e63e37e req-5b924b2d-e73c-4f5b-ab2c-287c3b27f8c8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.1616285 Nov 15 17:48:38.329477 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd1203a-d3c4-44f7-a1fa-5e3ee1c63f09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37d4468e-da3e-40c0-8932-5403397f4256,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:38.333925 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4bd1203a-d3c4-44f7-a1fa-5e3ee1c63f09 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c7f57ffbc82e4388a429c35ae8355eaa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6872914 Nov 15 17:48:38.339092 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52164) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:38.356093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.370208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.372981 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.376283 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1ce34d80-657b-46d9-a3ec-1ab10ae53881 HTTP/1.1" status: 204 len: 168 time: 0.8388999 Nov 15 17:48:38.419898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.428263 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0ceddf6e-1707-4321-b098-43573e63e37e req-0062a60c-7536-4e54-9bc0-00426dc418ae tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423469 Nov 15 17:48:38.445927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-511441cf-63ed-433a-9373-cbdf3d09a1ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ce34d80-657b-46d9-a3ec-1ab10ae53881,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:38.461832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-4827b52c-5423-40f4-8518-dc7fcc0d0370 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:38.464085 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.469728 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-4827b52c-5423-40f4-8518-dc7fcc0d0370 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.1930096 Nov 15 17:48:38.475058 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-918621e7-391c-42e5-b246-206d2a246edb req-8c89fe0a-210a-4e47-8a81-c3a1cdf6c569 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3421001 Nov 15 17:48:38.514520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.522263 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-7d5ae793-83c4-4f48-a8cb-71bd5a1f9d46 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0372965 Nov 15 17:48:38.526759 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b2dc8983-ca37-4c83-9f13-db0436001175 req-7b208033-786f-4e59-9775-ad093d3f1d26 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2649765 Nov 15 17:48:38.532789 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.554190 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.557123 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.559779 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/05705cbd-2677-41d8-b16b-9966b3258004 HTTP/1.1" status: 204 len: 168 time: 0.5835173 Nov 15 17:48:38.599664 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:38.603146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:38.607000 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:38.613152 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:38.615626 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b93731e-c312-4994-8dde-eea320c90947" -d '{"events": [{"name": "network-changed", "server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:38.630986 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1e77b8-237d-49be-86db-1fc25c33c538 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05705cbd-2677-41d8-b16b-9966b3258004,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:38.648713 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=239541d0-8ab6-4c43-b1ad-aa695f376731,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:38.684011 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-b3e9d326-a329-42c3-888b-a744724a37de service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1412549 Nov 15 17:48:38.717017 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.719673 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.723276 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/37d4468e-da3e-40c0-8932-5403397f4256 HTTP/1.1" status: 204 len: 168 time: 0.3749735 Nov 15 17:48:38.744224 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.746236 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ea3fe4-c170-419f-a579-fb13758710ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37d4468e-da3e-40c0-8932-5403397f4256,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:38.797995 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:38.859474 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7338cfa-ef4b-43c3-8b46-9312b5b4c60e x-openstack-request-id: req-e7338cfa-ef4b-43c3-8b46-9312b5b4c60e {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:38.860028 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:38.860468 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e7338cfa-ef4b-43c3-8b46-9312b5b4c60e {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:38.861119 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50', 'status': 'completed', 'code': 200} Nov 15 17:48:38.884124 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-38f5122e-8c5b-48f1-ae5b-ae03856d9c9f req-54dd2db1-dffa-4e96-9a94-e1295c55c685 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1901834 Nov 15 17:48:38.941365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34530a59-82fd-411f-8dfe-15596b0fd4d7 req-348c5dbc-1133-4668-9ab8-e134f7af8548 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:38.942959 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34530a59-82fd-411f-8dfe-15596b0fd4d7 req-348c5dbc-1133-4668-9ab8-e134f7af8548 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 943 time: 0.1106956 Nov 15 17:48:38.961829 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b93731e-c312-4994-8dde-eea320c90947 req-a1b5a0d9-01f2-4ef7-a159-476b89a7b367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:38.964631 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-a1b5a0d9-01f2-4ef7-a159-476b89a7b367 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1097 time: 0.0792923 Nov 15 17:48:39.014456 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34530a59-82fd-411f-8dfe-15596b0fd4d7 req-449e72c2-58b9-45d4-aa25-13f51de62f1f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620944 Nov 15 17:48:39.077167 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a175195-3e85-43a6-af9a-22f93c7d72d3 req-0a45cfca-e5ae-481e-b526-1a728e0c4b9f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:39.078695 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3a175195-3e85-43a6-af9a-22f93c7d72d3 req-0a45cfca-e5ae-481e-b526-1a728e0c4b9f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 943 time: 0.1046333 Nov 15 17:48:39.099601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b93731e-c312-4994-8dde-eea320c90947 req-bf97e60a-58d6-4298-92e9-ea82aa5dea61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:39.101825 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-bf97e60a-58d6-4298-92e9-ea82aa5dea61 service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.1273668 Nov 15 17:48:39.112374 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.125845 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.154869 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52194) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:39.161991 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-d43c5a30-7eb2-485b-a348-94519f96eaf4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0524886 Nov 15 17:48:39.176029 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.182916 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8f95aa0-84bd-4901-8876-4783e0a90308 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.194448 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3a175195-3e85-43a6-af9a-22f93c7d72d3 req-c045d775-e01d-4f18-aa82-6a22dd76450a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1093438 Nov 15 17:48:39.198776 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=239541d0-8ab6-4c43-b1ad-aa695f376731,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:39.211916 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.213316 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2a872101-0011-48dc-95c1-93bf62651dfa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7070987 Nov 15 17:48:39.266815 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b93731e-c312-4994-8dde-eea320c90947 req-67960df6-839a-487e-8a98-c9666e961580 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:39.268364 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-67960df6-839a-487e-8a98-c9666e961580 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0939796 Nov 15 17:48:39.316453 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-60fb8b0a-3316-47b7-8123-fd489b640d51 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381763 Nov 15 17:48:39.416035 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8f95aa0-84bd-4901-8876-4783e0a90308 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.420798 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8f95aa0-84bd-4901-8876-4783e0a90308 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.647446 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ed730f-ac2b-4a62-a01b-a263ccfb5807 req-a9270292-a7e9-4ee1-843c-817e5d770cf7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:39.649303 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55ed730f-ac2b-4a62-a01b-a263ccfb5807 req-a9270292-a7e9-4ee1-843c-817e5d770cf7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.0978074 Nov 15 17:48:39.660220 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c8f95aa0-84bd-4901-8876-4783e0a90308 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=00a7843ccb424eeebacd3ed9e16cb8a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5040071 Nov 15 17:48:39.665455 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52232) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:39.668358 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-e44b6bcf-1329-4d02-8d74-e1cade52173a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1373938000&fields=id&tenant_id=230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 267 time: 0.1551852 Nov 15 17:48:39.674989 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f95aa0-84bd-4901-8876-4783e0a90308 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6cda091-dd18-42af-99cb-23d7e8bf29e2,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:39.679254 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-136b085a-a2e3-43be-b7fd-057f0bdb2779 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3510902 Nov 15 17:48:39.775989 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55ed730f-ac2b-4a62-a01b-a263ccfb5807 req-31fbc499-45b4-4329-81dd-44b68a882097 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061695 Nov 15 17:48:39.803176 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.853899 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-8e8d61ee-c124-4ffd-80f0-334a8e92c8a2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:39.855740 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.860295 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-8e8d61ee-c124-4ffd-80f0-334a8e92c8a2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 811 time: 0.1624765 Nov 15 17:48:39.863950 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b93731e-c312-4994-8dde-eea320c90947 req-a24b926a-f8c7-4e63-aa81-676d8a337b84 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1769013 Nov 15 17:48:39.884341 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-4121cc83-1e67-4d8f-bfd2-5a01e2d7c702 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/quotas/230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 375 time: 0.0196736 Nov 15 17:48:39.921694 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.928286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:39.930048 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/b6cda091-dd18-42af-99cb-23d7e8bf29e2 HTTP/1.1" status: 204 len: 168 time: 0.2618542 Nov 15 17:48:39.940227 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f67f8f-49e7-4b29-a928-c46088e5edf4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6cda091-dd18-42af-99cb-23d7e8bf29e2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:39.977174 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-e8c3514c-5efc-4a06-95c2-4d898b181d6c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0715151 Nov 15 17:48:40.112258 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-b0fd8d95-ff16-4c0e-8c0e-594b27e8d7b5 service neutron] 10.222.0.31 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1147454 Nov 15 17:48:40.206077 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279cdaeb-a525-4df6-9581-104505d89bb5 req-c7b4fd50-17d3-4d0e-b5cf-1ef330ae113f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:40.207740 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-279cdaeb-a525-4df6-9581-104505d89bb5 req-c7b4fd50-17d3-4d0e-b5cf-1ef330ae113f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 943 time: 0.1165633 Nov 15 17:48:40.265402 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-6c15c931-faa3-43d7-a933-c08c3e486208 service neutron] 10.222.0.31 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1366198 Nov 15 17:48:40.303321 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-279cdaeb-a525-4df6-9581-104505d89bb5 req-5e35f6cf-150c-4cd2-964c-d9f28ec4f8b9 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772395 Nov 15 17:48:40.418819 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6daebb3e-344b-4da8-b642-75a9fff2120d req-52621233-beb8-4808-a416-ab3f20cce482 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:40.420545 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6daebb3e-344b-4da8-b642-75a9fff2120d req-52621233-beb8-4808-a416-ab3f20cce482 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 943 time: 0.0605581 Nov 15 17:48:40.500686 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6daebb3e-344b-4da8-b642-75a9fff2120d req-c2a1d943-145a-48f3-82ed-98f569fedd68 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728252 Nov 15 17:48:40.535060 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-11b2c730-d646-40d5-89f3-f273f14ef7e6 req-f5a84146-3a7b-4067-9367-1f492e7de642 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 210 time: 0.0332627 Nov 15 17:48:40.542920 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e458b3e-0cc6-4756-a46f-7648dc4c8384 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:48:40.691354 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:40.706214 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '0e458b3e-0cc6-4756-a46f-7648dc4c8384', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'port_id': '0e458b3e-0cc6-4756-a46f-7648dc4c8384', 'mac_address': 'fa:16:3e:a8:a6:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 444, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b912b7e-3193-418b-9139-60018a571278', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:48:40.749263 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:40.767200 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e458b3e-0cc6-4756-a46f-7648dc4c8384 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:40.793413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:40.805673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:40.806786 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:48:40.925962 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:40.966972 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ecd3876-fc3b-4e40-bc20-3023724c276b req-83f94c84-1bda-442d-aa6a-e343a7baa76c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:40.975484 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ecd3876-fc3b-4e40-bc20-3023724c276b req-83f94c84-1bda-442d-aa6a-e343a7baa76c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 943 time: 0.0859339 Nov 15 17:48:40.980930 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,segment=NetworkSegment(c9c85cd9-2596-49ad-ac18-9a7fdef83b16),segment_id=c9c85cd9-2596-49ad-ac18-9a7fdef83b16)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:40.998031 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98', 'network_id': 'c6711a21-f84e-4a09-b311-4dc71011fb84', 'port_id': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98', 'mac_address': 'fa:16:3e:e1:ca:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 436, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '28e89ccf-c78a-4f2e-be95-0646f1dfc889', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:48:41.041976 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:41.049284 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ecd3876-fc3b-4e40-bc20-3023724c276b req-0a2bb352-3411-4de1-bda8-ef658ac1abeb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726902 Nov 15 17:48:41.072113 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:41.090862 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,segment=NetworkSegment(c9c85cd9-2596-49ad-ac18-9a7fdef83b16),segment_id=c9c85cd9-2596-49ad-ac18-9a7fdef83b16)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:41.099673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:41.100979 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6eb8cabb-711a-47ac-965c-82db4534f237 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:48:41.237952 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:41.280466 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6eb8cabb-711a-47ac-965c-82db4534f237,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:41.296434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '6eb8cabb-711a-47ac-965c-82db4534f237', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'port_id': '6eb8cabb-711a-47ac-965c-82db4534f237', 'mac_address': 'fa:16:3e:04:a3:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 431, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6a2eeae-0fac-4586-be17-093ae2e28ec5', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:48:41.336545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:41.351293 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6eb8cabb-711a-47ac-965c-82db4534f237 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:41.377428 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6eb8cabb-711a-47ac-965c-82db4534f237,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:41.383387 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:41.490649 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:41.534567 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaba95dd-0512-4fbf-96cb-0aff027c5b4f req-e95441f4-f3c4-420f-93ae-46b89140c469 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:41.548077 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eaba95dd-0512-4fbf-96cb-0aff027c5b4f req-e95441f4-f3c4-420f-93ae-46b89140c469 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 944 time: 0.1210907 Nov 15 17:48:41.676810 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eaba95dd-0512-4fbf-96cb-0aff027c5b4f req-20ebf59a-1921-4222-80fe-91c33aeb50ba tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1268599 Nov 15 17:48:41.687006 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3a2128-8c17-40b5-8a5c-cd1c7815ca7f req-d424fadd-6ca4-4cc0-93f3-54c2031c0b34 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:41.694948 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-da3a2128-8c17-40b5-8a5c-cd1c7815ca7f req-d424fadd-6ca4-4cc0-93f3-54c2031c0b34 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 944 time: 0.1148431 Nov 15 17:48:41.708366 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['998a7bad-c8ca-4278-93c2-bc9e99bb6c98'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:48:41.784594 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52332) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:41.795558 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-da3a2128-8c17-40b5-8a5c-cd1c7815ca7f req-fe7ee0c4-5fc7-4e1e-9e67-4da000d099ab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993640 Nov 15 17:48:41.808126 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['0e458b3e-0cc6-4756-a46f-7648dc4c8384'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:48:41.820036 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:48:41.877758 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5e38e144-8c01-4299-ba86-827b22e17ac7 req-7b043cd4-79eb-484b-8a2a-0a3f7ae9f8ef tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 210 time: 0.0500908 Nov 15 17:48:41.997552 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1643320848-network', 'tenant_id': '62d3811eecaf4dc380a95a1675a940ca'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:42.051672 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Made reservation on behalf of 62d3811eecaf4dc380a95a1675a940ca for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:42.059590 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.081344 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.149691 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-2c71770b-19b7-4640-be07-0e8ae9808106 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:42.151314 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-2c71770b-19b7-4640-be07-0e8ae9808106 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 811 time: 0.2292688 Nov 15 17:48:42.262332 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4694e1fd-73ac-4091-be72-49d2450e7569 req-b831dcb3-bb53-4826-832e-565751637dfb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:42.270115 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4694e1fd-73ac-4091-be72-49d2450e7569 req-b831dcb3-bb53-4826-832e-565751637dfb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 944 time: 0.0922778 Nov 15 17:48:42.286295 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-cc8926e2-49ff-49c2-9959-c1ae2c0f91e3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 380 time: 0.1190121 Nov 15 17:48:42.301532 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'port': {'device_id': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'admin_state_up': True, 'tenant_id': '230fd761d538456998d7b335d14192ff', 'security_groups': ['4763e2ec-c45b-467d-b585-24d2e073d880']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:42.354720 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4694e1fd-73ac-4091-be72-49d2450e7569 req-01c8305a-4a07-4b12-96f6-5809d53e3ee1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837586 Nov 15 17:48:42.371625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.383571 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.415986 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] vlan segment allocate from pool success with {'vlan_id': 417, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:42.441406 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e3493cd-1392-4668-914c-6e09216e0af6,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:42.450905 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.451247 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Added segment 1a8102c5-9bac-4a12-b726-0db00fca42fc of type vlan for network a0aaa9f8-3cc0-4fae-883d-66b83c401ccb Nov 15 17:48:42.514832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.522777 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 83d5ff18-1a58-411f-945c-9a39c617ae50 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:48:42.528645 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Made reservation on behalf of 230fd761d538456998d7b335d14192ff for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:42.532638 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.561403 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.562371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:42.562973 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.639447 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.8532069 Nov 15 17:48:42.640780 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=83d5ff18-1a58-411f-945c-9a39c617ae50,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:42.642435 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52364) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:42.648997 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Request body: {'subnet': {'network_id': 'a0aaa9f8-3cc0-4fae-883d-66b83c401ccb', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1643320848-subnet', 'tenant_id': '62d3811eecaf4dc380a95a1675a940ca', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:42.654478 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '83d5ff18-1a58-411f-945c-9a39c617ae50', 'network_id': 'f25d23f6-7f59-4624-979f-a398984b16c9', 'port_id': '83d5ff18-1a58-411f-945c-9a39c617ae50', 'mac_address': 'fa:16:3e:54:6f:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 444, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b912b7e-3193-418b-9139-60018a571278', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:48:42.681404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c3f959-e382-4a1b-85ef-2682f5adc2d4 admin admin] Pushing event updated for resources: {'Network': ['ID=a0aaa9f8-3cc0-4fae-883d-66b83c401ccb,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:42.685220 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Made reservation on behalf of 62d3811eecaf4dc380a95a1675a940ca for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:42.697360 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.697635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network a0aaa9f8-3cc0-4fae-883d-66b83c401ccb details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:42.714532 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.761201 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 83d5ff18-1a58-411f-945c-9a39c617ae50 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:42.769291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Allocated IP 172.20.0.11 (e40bb745-7523-4329-91e3-c55442c5a8fa/ceb6358c-736e-42b9-8a34-e129c4912f6f/292c8c58-e8da-4843-ba3f-a998315a35b0) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:48:42.925159 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=83d5ff18-1a58-411f-945c-9a39c617ae50,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:42.931094 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.968424 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:42.987822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f014624-7e7f-436d-b619-8f53b8bea067 req-f4097b39-5120-4f2a-a62c-a0b29ace2d9b tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:42.995640 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:42.995858 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6f014624-7e7f-436d-b619-8f53b8bea067 req-f4097b39-5120-4f2a-a62c-a0b29ace2d9b tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 944 time: 0.2266273 Nov 15 17:48:43.015225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.039010 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.067497 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Network e40bb745-7523-4329-91e3-c55442c5a8fa is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:48:43.074439 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:43.076941 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:48:43.083461 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:43.084066 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.088214 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:43.106220 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe727fcd-2bf1-4719-bc73-07ef9119e822 req-b92be83d-fdd0-4195-8486-941c5af4e8b1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:43.110383 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fe727fcd-2bf1-4719-bc73-07ef9119e822 req-b92be83d-fdd0-4195-8486-941c5af4e8b1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 944 time: 0.2046061 Nov 15 17:48:43.113539 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-554655ca-4265-4eb0-a3d2-cb52aa27f784 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8170977 Nov 15 17:48:43.126160 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Request body: {'port': {'device_id': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:43.152972 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6f014624-7e7f-436d-b619-8f53b8bea067 req-f30b8142-d2ff-41ae-80da-8cdc03c69b30 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1555510 Nov 15 17:48:43.165529 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['83d5ff18-1a58-411f-945c-9a39c617ae50'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:48:43.214697 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.219853 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae0e3c87-9a00-49c9-8cff-0cc1140367a2,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:43.254784 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Checking segment: {'id': '1a8102c5-9bac-4a12-b726-0db00fca42fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 417, 'network_id': 'a0aaa9f8-3cc0-4fae-883d-66b83c401ccb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:43.255112 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Network hostable DHCP agents. Network: a0aaa9f8-3cc0-4fae-883d-66b83c401ccb, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:43.297341 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fe727fcd-2bf1-4719-bc73-07ef9119e822 req-5b467719-563b-43fe-977f-7007904aa5e0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1678481 Nov 15 17:48:43.341523 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b74fda-ed36-46e8-b1e8-5c10873fd602 req-43180554-d8a9-4c98-9ff8-91e088293d94 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:43.343158 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d7b74fda-ed36-46e8-b1e8-5c10873fd602 req-43180554-d8a9-4c98-9ff8-91e088293d94 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 932 time: 0.0916960 Nov 15 17:48:43.344346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Network a0aaa9f8-3cc0-4fae-883d-66b83c401ccb is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:43.367682 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, a0aaa9f8-3cc0-4fae-883d-66b83c401ccb) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:43.378945 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8951d26-7a70-4363-9316-3789ba7d432e None None] Network a0aaa9f8-3cc0-4fae-883d-66b83c401ccb requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:43.385529 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:43.385970 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.420338 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d7b74fda-ed36-46e8-b1e8-5c10873fd602 req-06d285d9-6dae-4e57-afea-9e41016a7145 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697303 Nov 15 17:48:43.434011 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ee0347f6-e8ee-41c1-a64a-f357c1b73bb5 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.7901988 Nov 15 17:48:43.493478 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-90f3306d-b9fe-4f09-a0e9-52510210fa49 None None] Provisioning complete for port 292c8c58-e8da-4843-ba3f-a998315a35b0 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:43.493841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-90f3306d-b9fe-4f09-a0e9-52510210fa49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.516300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e3ee6b-da37-4645-8f47-4f2b58dc9411 req-2fd31811-3453-4b15-8783-79d3afd326b1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:43.518395 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-80e3ee6b-da37-4645-8f47-4f2b58dc9411 req-2fd31811-3453-4b15-8783-79d3afd326b1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 944 time: 0.0574002 Nov 15 17:48:43.573627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 292c8c58-e8da-4843-ba3f-a998315a35b0 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:43.589381 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-80e3ee6b-da37-4645-8f47-4f2b58dc9411 req-2c7ce171-2088-4bec-9f27-4e4e4f86c609 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640409 Nov 15 17:48:43.590721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.607641 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-729a6011-28d3-4e5c-8d95-4abc8beef033 None None] Network a0aaa9f8-3cc0-4fae-883d-66b83c401ccb requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:43.611847 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-90f3306d-b9fe-4f09-a0e9-52510210fa49 None None] Port 292c8c58-e8da-4843-ba3f-a998315a35b0 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:48:43.625573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Transition to ACTIVE for port object 292c8c58-e8da-4843-ba3f-a998315a35b0 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:48:43.646563 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.731093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Pushing event updated for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:43.802587 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Attempting to bind port 292c8c58-e8da-4843-ba3f-a998315a35b0 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:48:43.803149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Attempting to bind port 292c8c58-e8da-4843-ba3f-a998315a35b0 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:48:43.803712 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Attempting to bind port 292c8c58-e8da-4843-ba3f-a998315a35b0 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:43.809592 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Port 292c8c58-e8da-4843-ba3f-a998315a35b0 on network e40bb745-7523-4329-91e3-c55442c5a8fa not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:48:43.810577 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Attempting to bind port 292c8c58-e8da-4843-ba3f-a998315a35b0 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:48:43.816973 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:48:43.817305 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Checking segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:43.817688 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Bound using segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:48:43.818115 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Bound port: 292c8c58-e8da-4843-ba3f-a998315a35b0, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:48:43.818466 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:43.904286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:48:43.908117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=292c8c58-e8da-4843-ba3f-a998315a35b0,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:48:43.916304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.007835 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Pushing event updated for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:44.014557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.015714 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.017142 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-d533a93a-83fe-4b1f-8794-d5e2fa3d8473 service neutron] 10.222.0.48 "PUT /v2.0/ports/292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 1094 time: 0.8954990 Nov 15 17:48:44.017590 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:44.022478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-675c0361-a240-435c-aa8d-d99be98c8aa2" -d '{"events": [{"name": "network-changed", "server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:44.042664 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:48:44.080932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce61260b-9aa0-4164-b7b6-52c4562be936 x-openstack-request-id: req-ce61260b-9aa0-4164-b7b6-52c4562be936 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:44.081293 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:44.081613 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ce61260b-9aa0-4164-b7b6-52c4562be936 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:44.082069 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'status': 'completed', 'code': 200} Nov 15 17:48:44.278905 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52426) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:44.284252 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1211395718-network', 'tenant_id': '82e4c683c0b4464292208d8706b8f36e'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:44.285688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab070c89-712d-49e7-a43e-da492f053fc7 req-8868cef3-1b0a-43ca-ac00-653e767e5a91 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.287172 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ab070c89-712d-49e7-a43e-da492f053fc7 req-8868cef3-1b0a-43ca-ac00-653e767e5a91 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 944 time: 0.0598755 Nov 15 17:48:44.304999 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Made reservation on behalf of 82e4c683c0b4464292208d8706b8f36e for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:44.307257 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.316207 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.335790 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ab070c89-712d-49e7-a43e-da492f053fc7 req-3b91bb24-b667-4571-8457-b312e0593c69 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421233 Nov 15 17:48:44.403542 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.408095 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.422175 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e2a9e4-3f09-4332-b544-13b61a1ebd57 req-69eed117-7d56-4cbe-b656-425f5b6cb022 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.423764 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-25e2a9e4-3f09-4332-b544-13b61a1ebd57 req-69eed117-7d56-4cbe-b656-425f5b6cb022 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 944 time: 0.0562489 Nov 15 17:48:44.433096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] vlan segment allocate from pool success with {'vlan_id': 427, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:48:44.448870 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa788283-e711-4f14-bd0c-2f7715de4a35,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:44.451889 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.452285 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Added segment d7952dc5-9c3c-44e7-9833-0361c2394bab of type vlan for network 312bd15f-fee1-4b06-b191-ca86881aa87d Nov 15 17:48:44.492654 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.500358 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-25e2a9e4-3f09-4332-b544-13b61a1ebd57 req-3592c5df-2754-4788-9513-97503e677b76 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700946 Nov 15 17:48:44.529925 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.530917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.531624 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.539786 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894661b4-cd28-47b7-9732-9e81c7064f30 req-540a4236-c2e7-4696-b45b-447a8d79b277 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.541345 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-894661b4-cd28-47b7-9732-9e81c7064f30 req-540a4236-c2e7-4696-b45b-447a8d79b277 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0570707 Nov 15 17:48:44.580990 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.3007877 Nov 15 17:48:44.587691 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52432) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:44.594334 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Request body: {'subnet': {'network_id': '312bd15f-fee1-4b06-b191-ca86881aa87d', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1211395718-subnet', 'tenant_id': '82e4c683c0b4464292208d8706b8f36e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:48:44.595576 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-894661b4-cd28-47b7-9732-9e81c7064f30 req-4973cf7b-e168-4055-aeee-004652ee111c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476124 Nov 15 17:48:44.602378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514f7f29-27a8-4eb0-adc3-81884cf4960a admin admin] Pushing event updated for resources: {'Network': ['ID=312bd15f-fee1-4b06-b191-ca86881aa87d,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:44.614441 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 312bd15f-fee1-4b06-b191-ca86881aa87d details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:48:44.627504 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Made reservation on behalf of 82e4c683c0b4464292208d8706b8f36e for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:48:44.629917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.748012 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfc80eb-6a2a-4502-a5c7-8a7185fdae14 req-04b6f832-4a89-4d5d-b963-322f9b969fdb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.749525 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-edfc80eb-6a2a-4502-a5c7-8a7185fdae14 req-04b6f832-4a89-4d5d-b963-322f9b969fdb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 944 time: 0.0497091 Nov 15 17:48:44.798130 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-edfc80eb-6a2a-4502-a5c7-8a7185fdae14 req-920fd8c3-8185-4d8d-a303-580018a49b99 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425987 Nov 15 17:48:44.800694 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.848181 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3c5c9dd1-b642-450c-8194-fc6f25cd4482,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:44.862869 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Checking segment: {'id': 'd7952dc5-9c3c-44e7-9833-0361c2394bab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 427, 'network_id': '312bd15f-fee1-4b06-b191-ca86881aa87d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:48:44.863215 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Network hostable DHCP agents. Network: 312bd15f-fee1-4b06-b191-ca86881aa87d, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:48:44.882283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Network 312bd15f-fee1-4b06-b191-ca86881aa87d is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:48:44.891333 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 312bd15f-fee1-4b06-b191-ca86881aa87d) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:48:44.895123 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:44.895731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:44.901167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e69415f-0162-4210-ba3c-9cdf5b222a31 None None] Network 312bd15f-fee1-4b06-b191-ca86881aa87d requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:44.911133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-42eb7762-15a3-4882-a14c-293d8a90e8c4 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3225794 Nov 15 17:48:45.020858 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52438) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:45.025688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b54ae85-996d-4d10-a669-ffb21dd90a6b None None] Network 312bd15f-fee1-4b06-b191-ca86881aa87d requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:48:45.067308 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Deleting subnet ae0e3c87-9a00-49c9-8cff-0cc1140367a2 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:48:45.070630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.104257 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.113478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.169801 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.196255 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae0e3c87-9a00-49c9-8cff-0cc1140367a2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:45.199968 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.203303 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c726da8b-2235-4e3a-b922-291029570a0f admin admin] 10.222.0.31 "DELETE /v2.0/subnets/ae0e3c87-9a00-49c9-8cff-0cc1140367a2 HTTP/1.1" status: 204 len: 168 time: 0.1813846 Nov 15 17:48:45.205737 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52448) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:45.277512 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.361971 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.382258 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.382612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.383315 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.383637 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > port after_create 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.384008 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > port after_delete 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.384296 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > port after_update 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.384653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.384960 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.385268 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.385574 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.458459 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ead0010-2fe6-47ca-8df0-4de26dc0d70a req-b1332551-36c6-4656-b78c-b171b37dcd8f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:45.460027 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ead0010-2fe6-47ca-8df0-4de26dc0d70a req-b1332551-36c6-4656-b78c-b171b37dcd8f tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 944 time: 0.0518780 Nov 15 17:48:45.511959 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ead0010-2fe6-47ca-8df0-4de26dc0d70a req-e913d908-1f70-4956-a5db-fde2e6809767 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447581 Nov 15 17:48:45.545712 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.546049 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.546377 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.546698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:48:45.547061 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a0aaa9f8-3cc0-4fae-883d-66b83c401ccb']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:45.565659 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a8102c5-9bac-4a12-b726-0db00fca42fc') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:45.565927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a8102c5-9bac-4a12-b726-0db00fca42fc') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:45.582973 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.604384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.613358 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Releasing vlan 417 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:48:45.613641 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.615494 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a5c736-577b-48dc-88ae-f86e8cd591fc req-efacb7d8-dcd2-4cbf-b29b-16bd84d2ac80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:45.617154 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8a5c736-577b-48dc-88ae-f86e8cd591fc req-efacb7d8-dcd2-4cbf-b29b-16bd84d2ac80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 944 time: 0.0487781 Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: from cryptography.utils import int_from_bytes Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: from cryptography.utils import int_from_bytes Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:48:45.617942 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:48:45.671166 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8a5c736-577b-48dc-88ae-f86e8cd591fc req-490aaa19-f0db-47ac-9b5a-17b484745654 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474305 Nov 15 17:48:45.694105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.701863 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.705166 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] 10.222.0.31 "DELETE /v2.0/networks/a0aaa9f8-3cc0-4fae-883d-66b83c401ccb HTTP/1.1" status: 204 len: 168 time: 0.4985108 Nov 15 17:48:45.708592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52456) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:45.714868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3b1f9b-748e-4956-863c-8bda83faa5de admin admin] Pushing event deleted for resources: {'Network': ['ID=a0aaa9f8-3cc0-4fae-883d-66b83c401ccb,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:45.764766 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18645242-9d35-4fd9-b23a-a4d2a2d11ec1 req-adb87d83-d93b-4505-a3e5-967f18733e1e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:45.766240 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18645242-9d35-4fd9-b23a-a4d2a2d11ec1 req-adb87d83-d93b-4505-a3e5-967f18733e1e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0941837 Nov 15 17:48:45.773403 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Deleting subnet 3c5c9dd1-b642-450c-8194-fc6f25cd4482 {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:48:45.782012 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.833735 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.849473 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:45.855229 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18645242-9d35-4fd9-b23a-a4d2a2d11ec1 req-06b4ab3a-0662-4dee-b32f-e1a8a48311a5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0795565 Nov 15 17:48:45.943762 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b84aacf-364c-4730-81cd-ff0bb855bbf2 req-c60a0a2f-97ef-4883-99cd-a46d3f752b06 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:45.945348 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b84aacf-364c-4730-81cd-ff0bb855bbf2 req-c60a0a2f-97ef-4883-99cd-a46d3f752b06 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 944 time: 0.0716779 Nov 15 17:48:45.951013 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.076109 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e458b3e-0cc6-4756-a46f-7648dc4c8384 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:46.128484 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-88b4c538-5d3b-4434-a528-60fe454d5c00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.130050 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-88b4c538-5d3b-4434-a528-60fe454d5c00 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1097 time: 0.0444288 Nov 15 17:48:46.137167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:48:46.141768 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:46.142138 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.180102 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3c5c9dd1-b642-450c-8194-fc6f25cd4482,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:46.199463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.208334 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-a9d94c43-5fe2-433e-a27a-609f6cd75aa4 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/3c5c9dd1-b642-450c-8194-fc6f25cd4482 HTTP/1.1" status: 204 len: 168 time: 0.4987128 Nov 15 17:48:46.214625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52464) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:46.255962 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.267553 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b84aacf-364c-4730-81cd-ff0bb855bbf2 req-53726bb4-4de6-41dd-be57-d64e3960d4e2 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3111365 Nov 15 17:48:46.295168 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:46.377718 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:46.382877 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.383728 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:46.462246 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:46.478368 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-895299e1-0d37-4e6e-a528-07412f443777" -d '{"events": [{"server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "name": "network-vif-plugged", "status": "completed", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:46.487369 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:48:46.492417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:46.492837 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.534061 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.553582 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-fef94d94-59c2-4d0f-a26b-f58376d27c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.555300 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-fef94d94-59c2-4d0f-a26b-f58376d27c0b service neutron] 10.222.0.48 "GET /v2.0/networks?tenant_id=230fd761d538456998d7b335d14192ff&shared=False HTTP/1.1" status: 200 len: 912 time: 0.4167640 Nov 15 17:48:46.582751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf9bda00-01d1-458b-a6c6-976a3256bb13 x-openstack-request-id: req-cf9bda00-01d1-458b-a6c6-976a3256bb13 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:46.583055 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "name": "network-vif-plugged", "status": "completed", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:46.583303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-cf9bda00-01d1-458b-a6c6-976a3256bb13 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:46.583751 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384', 'code': 200} Nov 15 17:48:46.593916 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.637944 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,segment=NetworkSegment(c9c85cd9-2596-49ad-ac18-9a7fdef83b16),segment_id=c9c85cd9-2596-49ad-ac18-9a7fdef83b16)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:46.645819 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.646830 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6eb8cabb-711a-47ac-965c-82db4534f237 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:46.676067 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942b6a45-d28b-4b0e-829c-92cd5b37c4ce req-82779253-de2f-42b5-bafb-eab43b852836 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.677907 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-942b6a45-d28b-4b0e-829c-92cd5b37c4ce req-82779253-de2f-42b5-bafb-eab43b852836 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 944 time: 0.0683885 Nov 15 17:48:46.733548 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-942b6a45-d28b-4b0e-829c-92cd5b37c4ce req-bc286da8-d385-4d37-ac09-97a97bc6fde1 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441198 Nov 15 17:48:46.777872 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:46.795278 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 6eb8cabb-711a-47ac-965c-82db4534f237 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:48:46.799325 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 6eb8cabb-711a-47ac-965c-82db4534f237 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:46.799688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.803138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df015d71-ca14-4228-93cb-a01948ec8453 req-1da17148-11cc-485f-8d68-c81214e85738 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.804701 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-df015d71-ca14-4228-93cb-a01948ec8453 req-1da17148-11cc-485f-8d68-c81214e85738 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0521533 Nov 15 17:48:46.813010 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.853805 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-df015d71-ca14-4228-93cb-a01948ec8453 req-e9f63c7c-a236-40b5-8616-7af6e32f29fe tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419421 Nov 15 17:48:46.867944 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['312bd15f-fee1-4b06-b191-ca86881aa87d']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:46.880389 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.900328 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7952dc5-9c3c-44e7-9833-0361c2394bab') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:46.900612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7952dc5-9c3c-44e7-9833-0361c2394bab') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:48:46.914552 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6eb8cabb-711a-47ac-965c-82db4534f237,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:46.916293 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.918975 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-725e4904-ad83-4664-b104-f87e4045a1d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.920097 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.920555 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-725e4904-ad83-4664-b104-f87e4045a1d9 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 1098 time: 0.1855927 Nov 15 17:48:46.926153 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-61143b7d-90dc-46a0-ba17-4c2d0124fa9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:46.927548 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-675c0361-a240-435c-aa8d-d99be98c8aa2 req-61143b7d-90dc-46a0-ba17-4c2d0124fa9a service neutron] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3491633 Nov 15 17:48:46.944822 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.946965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-9469b654-7821-4df6-9a40-1a2c1d431392 service neutron] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.960030 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Releasing vlan 427 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:48:46.960439 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:48:46.962160 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:48:46.972265 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:47.004868 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d39427-8ec1-4563-b6c2-46fddf64cfb9 req-827b3a82-9293-49de-b0e1-fa0f260ab436 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.006341 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-37d39427-8ec1-4563-b6c2-46fddf64cfb9 req-827b3a82-9293-49de-b0e1-fa0f260ab436 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0631368 Nov 15 17:48:47.054960 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.058719 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-37d39427-8ec1-4563-b6c2-46fddf64cfb9 req-47c7051d-4d00-4b5f-b5d3-91354421d10f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446322 Nov 15 17:48:47.063846 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.066923 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] 10.222.0.31 "DELETE /v2.0/networks/312bd15f-fee1-4b06-b191-ca86881aa87d HTTP/1.1" status: 204 len: 168 time: 0.8513567 Nov 15 17:48:47.085594 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-450b7853-6e2a-447c-8e78-146f1223a34b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.087097 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-450b7853-6e2a-447c-8e78-146f1223a34b service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1097 time: 0.0919602 Nov 15 17:48:47.092313 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c4df3d-bd37-446f-81e1-33b2b2db6a89 admin admin] Pushing event deleted for resources: {'Network': ['ID=312bd15f-fee1-4b06-b191-ca86881aa87d,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:47.136065 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-692cc5aa-cc9c-4054-8681-eb676f3ca391 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 217 time: 0.0398388 Nov 15 17:48:47.201528 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-9469b654-7821-4df6-9a40-1a2c1d431392 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.205660 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-3122f061-21cc-4928-8b14-6905e0c7473c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.207390 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-3122f061-21cc-4928-8b14-6905e0c7473c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0613401 Nov 15 17:48:47.208553 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-9469b654-7821-4df6-9a40-1a2c1d431392 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.234355 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52488) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:47.285155 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-510913e8-9f73-4a8c-b172-9ba16b0c5d38 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=62d3811eecaf4dc380a95a1675a940ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0495865 Nov 15 17:48:47.287976 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52496) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:47.307242 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2e501e66-336e-45b4-baa7-13a8a29916c6 req-9469b654-7821-4df6-9a40-1a2c1d431392 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3773077 Nov 15 17:48:47.309096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9469b654-7821-4df6-9a40-1a2c1d431392 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=04395792-e293-465d-bb6c-94fc9e6d07c6,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:47.324723 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-e44dff21-a1bc-4a3f-b4bf-a915ce1572fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.326226 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-e44dff21-a1bc-4a3f-b4bf-a915ce1572fe service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1093159 Nov 15 17:48:47.407067 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.422431 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a02f00-7002-4146-8e34-32e7d886cdd6 req-fa327463-adc3-43ff-a0fe-cf3383111cbb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.423990 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-13a02f00-7002-4146-8e34-32e7d886cdd6 req-fa327463-adc3-43ff-a0fe-cf3383111cbb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0723810 Nov 15 17:48:47.455257 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.509647 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-13a02f00-7002-4146-8e34-32e7d886cdd6 req-7ec59058-bd58-4701-b2f5-db8ce3c2001c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778456 Nov 15 17:48:47.542397 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.545119 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:47.547740 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4e3493cd-1392-4668-914c-6e09216e0af6 HTTP/1.1" status: 204 len: 168 time: 0.2569757 Nov 15 17:48:47.556596 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6cd5ef-3481-4e41-b191-f4b30b00d2d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e3493cd-1392-4668-914c-6e09216e0af6,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:47.672507 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-9154a006-e82d-40c7-9c6b-9a5b005e2808 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1477950 Nov 15 17:48:47.789381 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-be38d33d-b0d0-4008-84c6-ba80d05aa250 req-fb7f6f61-174c-43d1-b8cc-1143b7ea85c5 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1089132 Nov 15 17:48:47.871165 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e59519-30a5-41cf-a8e9-6f063d29db82 req-6988e49e-1a8f-4d80-8299-66934a98a08c tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:47.873183 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e9e59519-30a5-41cf-a8e9-6f063d29db82 req-6988e49e-1a8f-4d80-8299-66934a98a08c tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0656824 Nov 15 17:48:47.989039 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e9e59519-30a5-41cf-a8e9-6f063d29db82 req-7aa2712f-9d2a-41ce-a091-c0de082e0d70 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955215 Nov 15 17:48:48.006467 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52524) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:48.060845 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-e0405c9c-dc11-4281-97a9-44825dac51e5 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=82e4c683c0b4464292208d8706b8f36e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0531778 Nov 15 17:48:48.061433 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52530) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:48.064655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e64829-c136-4908-be50-5ad298ceb3fd req-99b985e4-d157-47f7-84e9-aeccd4b57a6f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:48.076861 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 83d5ff18-1a58-411f-945c-9a39c617ae50 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:48.091690 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-63e64829-c136-4908-be50-5ad298ceb3fd req-99b985e4-d157-47f7-84e9-aeccd4b57a6f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1385038 Nov 15 17:48:48.181477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.195457 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-63e64829-c136-4908-be50-5ad298ceb3fd req-88ead6fb-0e47-4e1f-a527-8f186d75bfaf tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955245 Nov 15 17:48:48.203911 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 83d5ff18-1a58-411f-945c-9a39c617ae50 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:48:48.209105 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 83d5ff18-1a58-411f-945c-9a39c617ae50 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:48.209735 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.248933 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e1264f-3df5-457d-bd1d-04aec08c97f4 req-103a383a-8cd0-49c8-a5fd-4c048014c6b7 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:48.250803 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71e1264f-3df5-457d-bd1d-04aec08c97f4 req-103a383a-8cd0-49c8-a5fd-4c048014c6b7 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0611637 Nov 15 17:48:48.257333 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.309052 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71e1264f-3df5-457d-bd1d-04aec08c97f4 req-7c5019c1-6634-4558-a6ad-3c29c4fde825 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508757 Nov 15 17:48:48.324324 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.327782 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.332359 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fa788283-e711-4f14-bd0c-2f7715de4a35 HTTP/1.1" status: 204 len: 168 time: 0.2698345 Nov 15 17:48:48.341680 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ba2419-5a66-4f4b-a62f-bb4d0f6324d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa788283-e711-4f14-bd0c-2f7715de4a35,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:48.368702 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.410340 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=83d5ff18-1a58-411f-945c-9a39c617ae50,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:48.415983 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:48.470679 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:48.585074 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98'}, {'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237'}, {'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:48.587800 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f717680-176b-4b22-b2c9-69668af01291" -d '{"events": [{"server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "name": "network-vif-plugged", "status": "completed", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98"}, {"server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "name": "network-vif-plugged", "status": "completed", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237"}, {"server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "name": "network-vif-plugged", "status": "completed", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:48.634885 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a41e2228-b14f-4de7-b040-7b6ea35a178a x-openstack-request-id: req-a41e2228-b14f-4de7-b040-7b6ea35a178a {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:48.635304 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "name": "network-vif-plugged", "status": "completed", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98", "code": 200}, {"server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "name": "network-vif-plugged", "status": "completed", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237", "code": 200}, {"server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "name": "network-vif-plugged", "status": "completed", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:48.635413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a41e2228-b14f-4de7-b040-7b6ea35a178a {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:48.636153 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98', 'code': 200} Nov 15 17:48:48.636331 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237', 'code': 200} Nov 15 17:48:48.636515 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50', 'code': 200} Nov 15 17:48:48.650520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a10fae-82a8-4a69-98fa-2c4139ec552a req-b35e5770-6a4d-4f76-933d-638946284379 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:48.656657 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b5a10fae-82a8-4a69-98fa-2c4139ec552a req-b35e5770-6a4d-4f76-933d-638946284379 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0637765 Nov 15 17:48:48.713914 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b5a10fae-82a8-4a69-98fa-2c4139ec552a req-7fe0f8da-8c81-46d3-b3db-1a8e00f4887a tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499115 Nov 15 17:48:49.102642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b682ca-20cb-43f9-839b-0f458f82b747 req-6d95da37-0182-410f-b9cf-42fc3f779a3a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:49.105034 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-82b682ca-20cb-43f9-839b-0f458f82b747 req-6d95da37-0182-410f-b9cf-42fc3f779a3a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0549445 Nov 15 17:48:49.164468 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-82b682ca-20cb-43f9-839b-0f458f82b747 req-2ba02124-3a1b-4bbe-a4bf-8c96e9756ade tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528445 Nov 15 17:48:49.295003 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1400b85-4b9f-4a2e-8ef5-28d4a9cee516 req-8829f3e5-73e2-43d9-a9d0-0679b2f9f891 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:49.296687 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a1400b85-4b9f-4a2e-8ef5-28d4a9cee516 req-8829f3e5-73e2-43d9-a9d0-0679b2f9f891 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0532043 Nov 15 17:48:49.346180 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a1400b85-4b9f-4a2e-8ef5-28d4a9cee516 req-e693c901-8f4a-45b0-b419-67f71d982608 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432680 Nov 15 17:48:49.448392 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e4a98c-b0d2-4b81-8dbd-16b79a9b8999 req-3046184c-bb2c-4c3e-a3ab-2b4df9f57c81 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:49.449923 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29e4a98c-b0d2-4b81-8dbd-16b79a9b8999 req-3046184c-bb2c-4c3e-a3ab-2b4df9f57c81 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0600536 Nov 15 17:48:49.497335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29e4a98c-b0d2-4b81-8dbd-16b79a9b8999 req-e86324be-9659-46eb-8acd-69028dc35977 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413060 Nov 15 17:48:49.844447 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1f5c2a-f7b5-44c0-8b26-d8c08d3b8c3d req-b525d680-e1b5-4e95-a669-6a0f2a74dd64 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:49.845956 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0a1f5c2a-f7b5-44c0-8b26-d8c08d3b8c3d req-b525d680-e1b5-4e95-a669-6a0f2a74dd64 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0509017 Nov 15 17:48:49.894589 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0a1f5c2a-f7b5-44c0-8b26-d8c08d3b8c3d req-fab49ee8-9094-42eb-b185-54bb022299d8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415616 Nov 15 17:48:50.286126 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcb2fb0-b8e4-44e4-9ef1-c781daaba946 req-81d5b047-9456-483e-b1f5-7d72c2e4eac2 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:50.287506 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cbcb2fb0-b8e4-44e4-9ef1-c781daaba946 req-81d5b047-9456-483e-b1f5-7d72c2e4eac2 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0511062 Nov 15 17:48:50.339186 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cbcb2fb0-b8e4-44e4-9ef1-c781daaba946 req-6a5e1f23-bde6-4db1-a164-910a3e01ac9b tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456457 Nov 15 17:48:50.474827 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1a0dcb-48ef-448b-a2f4-6b81d6a99db8 req-0bf34950-9c05-474f-ac55-994adc658f25 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:50.475676 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7c1a0dcb-48ef-448b-a2f4-6b81d6a99db8 req-0bf34950-9c05-474f-ac55-994adc658f25 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0503719 Nov 15 17:48:50.525034 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7c1a0dcb-48ef-448b-a2f4-6b81d6a99db8 req-4eecc1c3-833c-4894-b51a-aa42b30381be tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429742 Nov 15 17:48:50.615856 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8761e8-b8c5-4250-82d2-18276713c464 req-23bc8d82-527b-455e-8c8c-9511d1f307bf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:50.617768 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e8761e8-b8c5-4250-82d2-18276713c464 req-23bc8d82-527b-455e-8c8c-9511d1f307bf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0518470 Nov 15 17:48:50.671175 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e8761e8-b8c5-4250-82d2-18276713c464 req-ed57df67-1d7c-4bbe-b662-5e436a858ea2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465055 Nov 15 17:48:51.023950 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0285976-4a4e-4da4-ae4a-19c773fdbb9b req-5adff948-83ad-4a96-a118-e63e242dd957 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.025422 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0285976-4a4e-4da4-ae4a-19c773fdbb9b req-5adff948-83ad-4a96-a118-e63e242dd957 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0595028 Nov 15 17:48:51.075516 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0285976-4a4e-4da4-ae4a-19c773fdbb9b req-79038fda-4d70-44c9-b083-1eaacd0a77af tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414472 Nov 15 17:48:51.430781 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c96a1-b1c7-4811-9f41-a745d336822f req-68466374-9eba-42c5-b7ac-ecc6e73e183f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.432314 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1f3c96a1-b1c7-4811-9f41-a745d336822f req-68466374-9eba-42c5-b7ac-ecc6e73e183f service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 1098 time: 0.1039793 Nov 15 17:48:51.436588 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707030a1-e825-4883-bdf6-61ddd7771253 req-39649ecb-52dd-4008-ba0c-2060bb123ca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.437922 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-707030a1-e825-4883-bdf6-61ddd7771253 req-39649ecb-52dd-4008-ba0c-2060bb123ca2 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.1000807 Nov 15 17:48:51.447864 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3591cb76-3b5f-4b6f-a7bd-e5ac1ad9e2e4 req-0393f1c3-4e5c-4864-9719-a3a668cde847 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.449332 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3591cb76-3b5f-4b6f-a7bd-e5ac1ad9e2e4 req-0393f1c3-4e5c-4864-9719-a3a668cde847 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 1098 time: 0.0653696 Nov 15 17:48:51.471008 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7b0625-9b58-478d-90f5-474c8bd8c140 req-0c9c74b7-0e36-4f64-ae35-2bb8ae34c1b0 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.476672 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af7b0625-9b58-478d-90f5-474c8bd8c140 req-0c9c74b7-0e36-4f64-ae35-2bb8ae34c1b0 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0615153 Nov 15 17:48:51.524826 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af7b0625-9b58-478d-90f5-474c8bd8c140 req-e2a88be8-4608-45bf-a8aa-ed5f8c0ea00a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458097 Nov 15 17:48:51.544414 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-707030a1-e825-4883-bdf6-61ddd7771253 req-d5536e6e-c39c-461b-92ff-1d6bc52d5b93 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888274 Nov 15 17:48:51.554823 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3591cb76-3b5f-4b6f-a7bd-e5ac1ad9e2e4 req-4cfcc102-5765-49d4-a19a-cd5251fff3bb service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926435 Nov 15 17:48:51.556239 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1f3c96a1-b1c7-4811-9f41-a745d336822f req-e12165c7-b0a9-42ad-b693-dbefcab75390 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1059628 Nov 15 17:48:51.655153 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f557c72e-53c3-482d-a943-19c13a1eb432 req-302e4aa3-9824-463a-b0a9-30fd1fd9d4e0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.656659 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f557c72e-53c3-482d-a943-19c13a1eb432 req-302e4aa3-9824-463a-b0a9-30fd1fd9d4e0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0626571 Nov 15 17:48:51.693479 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:51.711580 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f557c72e-53c3-482d-a943-19c13a1eb432 req-d5ab4b8e-2646-4655-a79b-1294132b04c0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479369 Nov 15 17:48:51.785750 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d364cbe4-c25f-4f9a-87ef-fce8aed34065 req-a8f531e4-19ee-4671-84f0-78f2fa27abb2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:51.787232 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d364cbe4-c25f-4f9a-87ef-fce8aed34065 req-a8f531e4-19ee-4671-84f0-78f2fa27abb2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0491350 Nov 15 17:48:51.835735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d364cbe4-c25f-4f9a-87ef-fce8aed34065 req-3f36f46f-7f39-4c21-b043-2f88effb209b tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419483 Nov 15 17:48:52.193764 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032a9932-8e31-4b6b-9a70-c9f8ad61c7a0 req-fb759526-0b9b-49bf-9c07-4f5618aaa81d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:52.195968 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-032a9932-8e31-4b6b-9a70-c9f8ad61c7a0 req-fb759526-0b9b-49bf-9c07-4f5618aaa81d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0513964 Nov 15 17:48:52.248131 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-032a9932-8e31-4b6b-9a70-c9f8ad61c7a0 req-de1e0e5e-0da0-4ebc-bde1-75b2911b97c6 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461414 Nov 15 17:48:52.649745 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42840a77-94d3-4cfd-a79f-c75a2d028529 req-b8f2996b-7a0c-421f-923e-224726fb8f80 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:52.651521 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-42840a77-94d3-4cfd-a79f-c75a2d028529 req-b8f2996b-7a0c-421f-923e-224726fb8f80 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0556147 Nov 15 17:48:52.724298 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-42840a77-94d3-4cfd-a79f-c75a2d028529 req-e2457b94-7687-4932-ad4b-32d91e9a5c84 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599952 Nov 15 17:48:52.850565 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755865ff-99e4-4c83-8450-09fd918db00b req-d7b030fd-016a-4530-9e82-62704a429067 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:52.852976 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-755865ff-99e4-4c83-8450-09fd918db00b req-d7b030fd-016a-4530-9e82-62704a429067 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0637426 Nov 15 17:48:52.915272 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-755865ff-99e4-4c83-8450-09fd918db00b req-42a1c492-c048-4f41-9006-0e03fb91c0df tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561323 Nov 15 17:48:52.993344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d3a243-297a-4d28-a8a0-477065fdd29f req-27ea4be5-ffb9-4e28-95b5-dea22e33c640 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:52.997039 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10d3a243-297a-4d28-a8a0-477065fdd29f req-27ea4be5-ffb9-4e28-95b5-dea22e33c640 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0660584 Nov 15 17:48:53.073645 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10d3a243-297a-4d28-a8a0-477065fdd29f req-52c05d22-e203-4486-912a-3d304ca0ce04 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606999 Nov 15 17:48:53.324709 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-71aaf7f2-2d30-4500-b854-4154a334408e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.326944 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-71aaf7f2-2d30-4500-b854-4154a334408e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 1098 time: 0.0512347 Nov 15 17:48:53.358226 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52728) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:53.400843 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c056a949-aeeb-401e-94b6-5760c5fd59b1 req-e16ad56d-e4e5-4da9-be1f-70d83caa2a84 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.402521 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c056a949-aeeb-401e-94b6-5760c5fd59b1 req-e16ad56d-e4e5-4da9-be1f-70d83caa2a84 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1140838 Nov 15 17:48:53.447304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-bd93b4dd-1180-4c21-8199-cb72503dadac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.448909 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-bd93b4dd-1180-4c21-8199-cb72503dadac service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.1117365 Nov 15 17:48:53.454083 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2105b32f-5250-4e68-985e-229130665690 req-3ba575fd-7578-48a2-991f-1951780c455d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.455909 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2105b32f-5250-4e68-985e-229130665690 req-3ba575fd-7578-48a2-991f-1951780c455d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.1027815 Nov 15 17:48:53.506286 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c056a949-aeeb-401e-94b6-5760c5fd59b1 req-4e2550ea-b325-47bd-9936-554ed333169c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925369 Nov 15 17:48:53.513541 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-e6315263-363d-413e-a816-e56f885edbd4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384 HTTP/1.1" status: 200 len: 217 time: 0.0508029 Nov 15 17:48:53.532463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5057d732-1942-4f49-bbd8-53c3281c702b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.582627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-c5d25a91-6129-49e2-bffc-1f8c111c9267 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.584085 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-c5d25a91-6129-49e2-bffc-1f8c111c9267 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0595298 Nov 15 17:48:53.588353 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2105b32f-5250-4e68-985e-229130665690 req-000b56b1-2fd2-414d-9b49-c1e1dd088ac3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1210711 Nov 15 17:48:53.620759 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-b00ae01c-0cce-470d-9d66-e47635279c49 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256169 Nov 15 17:48:53.664411 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5057d732-1942-4f49-bbd8-53c3281c702b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.672928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5057d732-1942-4f49-bbd8-53c3281c702b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.715373 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5057d732-1942-4f49-bbd8-53c3281c702b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=92a9003a975040c4a988c61b7a9eb9e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3559842 Nov 15 17:48:53.716298 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5057d732-1942-4f49-bbd8-53c3281c702b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b82e220-32e7-4ad8-a091-befe53c1bb4e,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:53.718658 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52738) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:53.743056 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-c8ef15a5-c851-41c4-be96-3df73419e46d service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1122372 Nov 15 17:48:53.790418 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.828093 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.892667 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5c40b582-fad1-4286-b782-0cabd6f18a9b req-c0c5d26e-1eec-4a1c-9843-7efdad6e059f service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1321385 Nov 15 17:48:53.913593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966e39c7-17c6-46c9-aafa-4c73c0c42f15 req-069b2db0-805b-49c3-b2c7-28e3af72c33d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:53.915305 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-966e39c7-17c6-46c9-aafa-4c73c0c42f15 req-069b2db0-805b-49c3-b2c7-28e3af72c33d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0754776 Nov 15 17:48:53.936462 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.939013 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:53.940166 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/8b82e220-32e7-4ad8-a091-befe53c1bb4e HTTP/1.1" status: 204 len: 168 time: 0.2206066 Nov 15 17:48:53.956871 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5bd0f74-30e0-4595-92d2-9a21c3cf3f6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b82e220-32e7-4ad8-a091-befe53c1bb4e,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:53.994751 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-966e39c7-17c6-46c9-aafa-4c73c0c42f15 req-81f435b4-bd3c-4a3d-86e5-3c42b87a4b80 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724216 Nov 15 17:48:54.090388 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 292c8c58-e8da-4843-ba3f-a998315a35b0 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:48:54.219691 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=292c8c58-e8da-4843-ba3f-a998315a35b0,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:54.232031 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'port_id': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'mac_address': 'fa:16:3e:11:aa:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 409, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:48:54.266917 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86228dde-5921-4251-bb49-f68dc72bdd77 req-7fd1f8b0-7714-488b-bc97-a207923b095f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:54.268487 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86228dde-5921-4251-bb49-f68dc72bdd77 req-7fd1f8b0-7714-488b-bc97-a207923b095f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 944 time: 0.0689416 Nov 15 17:48:54.293059 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:54.331747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 292c8c58-e8da-4843-ba3f-a998315a35b0 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:48:54.338055 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86228dde-5921-4251-bb49-f68dc72bdd77 req-db7f4c01-bceb-4d6b-885c-e17e54b35399 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592687 Nov 15 17:48:54.377116 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=292c8c58-e8da-4843-ba3f-a998315a35b0,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:54.393028 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:54.449398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:54.632569 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91acd02-200b-435a-90c1-6540dc6a23f1 req-b4d3bd71-f11f-4764-afbb-fd9f203f80c7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:54.634256 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c91acd02-200b-435a-90c1-6540dc6a23f1 req-b4d3bd71-f11f-4764-afbb-fd9f203f80c7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0520947 Nov 15 17:48:54.713381 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c91acd02-200b-435a-90c1-6540dc6a23f1 req-d0cdcea4-f948-4867-9716-b43eac8f79e9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732448 Nov 15 17:48:54.726020 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab85a42-0a21-41dc-b7e1-0a69c20dbd5a req-48f84274-8c9e-4303-91e2-cc1667d05803 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:54.727643 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ab85a42-0a21-41dc-b7e1-0a69c20dbd5a req-48f84274-8c9e-4303-91e2-cc1667d05803 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0700321 Nov 15 17:48:54.776080 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ab85a42-0a21-41dc-b7e1-0a69c20dbd5a req-d1e2a30a-18e9-481d-86f3-c864c9708cec tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424182 Nov 15 17:48:55.469682 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc78934-a2b8-4737-a833-d46872a16a25 req-5b4960e5-3a71-4781-a8ae-3115610c2f7c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:55.472196 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2fc78934-a2b8-4737-a833-d46872a16a25 req-5b4960e5-3a71-4781-a8ae-3115610c2f7c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 945 time: 0.0732427 Nov 15 17:48:55.547047 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2fc78934-a2b8-4737-a833-d46872a16a25 req-196519a9-84ee-44ac-bee9-26c7270980cd tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0676472 Nov 15 17:48:55.833796 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1552c719-f280-4d1c-bea2-891b2e21ab23 req-20e334a6-7058-4669-81d0-8499b4995628 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:55.835326 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1552c719-f280-4d1c-bea2-891b2e21ab23 req-20e334a6-7058-4669-81d0-8499b4995628 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0526979 Nov 15 17:48:55.881664 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1552c719-f280-4d1c-bea2-891b2e21ab23 req-b0c3c861-d6e0-4946-9049-b7bde4455bfe tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398650 Nov 15 17:48:56.664670 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4afb1913-24ed-4d08-a2a3-2e52d7cf0914 req-90f03bf1-bebd-450b-9cfe-0a092aa46fd8 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:56.666259 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4afb1913-24ed-4d08-a2a3-2e52d7cf0914 req-90f03bf1-bebd-450b-9cfe-0a092aa46fd8 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 945 time: 0.0526879 Nov 15 17:48:56.714668 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4afb1913-24ed-4d08-a2a3-2e52d7cf0914 req-6761f6f7-9fcd-473f-b7dd-abc683414fce tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423617 Nov 15 17:48:57.006195 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8281983d-9053-41a5-b8d3-f6a00d57be66 req-5d07065e-3ac2-494a-847b-00a41bef1c42 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:57.007796 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8281983d-9053-41a5-b8d3-f6a00d57be66 req-5d07065e-3ac2-494a-847b-00a41bef1c42 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0566058 Nov 15 17:48:57.061370 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8281983d-9053-41a5-b8d3-f6a00d57be66 req-a9bc1cd6-1721-4d31-93ce-90238c922b0d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462549 Nov 15 17:48:57.489721 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['292c8c58-e8da-4843-ba3f-a998315a35b0'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:48:57.835740 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74538-0f80-4703-8e41-93d8e2da5b95 req-9859c1d4-a8fb-49b4-a006-a84a8b43adb5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:57.837655 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44d74538-0f80-4703-8e41-93d8e2da5b95 req-9859c1d4-a8fb-49b4-a006-a84a8b43adb5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 945 time: 0.0516384 Nov 15 17:48:57.887159 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44d74538-0f80-4703-8e41-93d8e2da5b95 req-33de3432-fb17-4def-b13e-20681e6e5f46 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434110 Nov 15 17:48:58.189270 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dccbbf2e-c049-4970-a116-dbb6be72bc36 req-ac44819f-a84f-4aa9-9157-dc37e42def35 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:58.198520 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dccbbf2e-c049-4970-a116-dbb6be72bc36 req-ac44819f-a84f-4aa9-9157-dc37e42def35 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0629041 Nov 15 17:48:58.268182 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dccbbf2e-c049-4970-a116-dbb6be72bc36 req-7b9b34e8-7035-4cfa-8277-f12284b511ea tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660293 Nov 15 17:48:59.019790 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdbb9288-0501-448c-a399-bb292aa219cc req-37509abb-faef-4986-aade-69d5f2e3c447 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:59.022379 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bdbb9288-0501-448c-a399-bb292aa219cc req-37509abb-faef-4986-aade-69d5f2e3c447 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 945 time: 0.0558839 Nov 15 17:48:59.080315 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bdbb9288-0501-448c-a399-bb292aa219cc req-a2169d8f-917a-45e7-a264-609ca116f7e8 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508580 Nov 15 17:48:59.170196 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 292c8c58-e8da-4843-ba3f-a998315a35b0 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:48:59.245555 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 292c8c58-e8da-4843-ba3f-a998315a35b0 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:48:59.250933 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 292c8c58-e8da-4843-ba3f-a998315a35b0 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:48:59.250933 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.260678 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52962) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:59.387512 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.424582 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:48:59.426971 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3e005be-2dad-4a95-a65d-34af7e52894d" -d '{"events": [{"server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "name": "network-vif-plugged", "status": "completed", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:48:59.441056 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3065c441-acd4-48ff-b777-8b9710f2ebe3 req-13bade98-d970-4395-942d-7a66f1c7f9c9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:59.448698 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3065c441-acd4-48ff-b777-8b9710f2ebe3 req-13bade98-d970-4395-942d-7a66f1c7f9c9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0814977 Nov 15 17:48:59.465404 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=292c8c58-e8da-4843-ba3f-a998315a35b0,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:48:59.475467 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.513684 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3065c441-acd4-48ff-b777-8b9710f2ebe3 req-5b6b8b93-477e-4f4a-b3a4-43b2804267d8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595603 Nov 15 17:48:59.540354 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:48:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c46cd5e3-11d9-4d91-8ded-db2f328daa60 x-openstack-request-id: req-c46cd5e3-11d9-4d91-8ded-db2f328daa60 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:48:59.540869 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "name": "network-vif-plugged", "status": "completed", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:48:59.541209 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c46cd5e3-11d9-4d91-8ded-db2f328daa60 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:48:59.541680 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'code': 200} Nov 15 17:48:59.559801 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:59.582685 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52974) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:59.633362 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89544d61-ce23-42cf-b02c-d3f5effd18f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.633866 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 52978) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:59.686744 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cff78438-2b45-432a-ac56-aec21f838b5c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.729413 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-28053e3b-c503-4fc3-b691-958a29460165 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.754041 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d552ac-77bc-496a-8008-5132524a1dea req-cf2abc72-cbde-42f5-8d6e-133961428a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:48:59.755914 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-57d552ac-77bc-496a-8008-5132524a1dea req-cf2abc72-cbde-42f5-8d6e-133961428a7e service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1099 time: 0.0727406 Nov 15 17:48:59.780553 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89544d61-ce23-42cf-b02c-d3f5effd18f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.787842 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89544d61-ce23-42cf-b02c-d3f5effd18f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.833707 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cff78438-2b45-432a-ac56-aec21f838b5c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.845418 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cff78438-2b45-432a-ac56-aec21f838b5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:48:59.871083 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-cff78438-2b45-432a-ac56-aec21f838b5c admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=fda1d204e4e54fecb939c0ada5235822&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2866833 Nov 15 17:48:59.873357 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-89544d61-ce23-42cf-b02c-d3f5effd18f7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=f5fc3f2d7bc7439c97d75264c18b5818&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6108088 Nov 15 17:48:59.873835 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52990) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:59.880099 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 52992) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:48:59.882673 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89544d61-ce23-42cf-b02c-d3f5effd18f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a66b9318-76a0-4946-a41a-177acd041550,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:59.961665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff78438-2b45-432a-ac56-aec21f838b5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=888f891d-9228-4348-887c-c95920678fb7,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:48:59.988108 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.019467 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.027144 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.034705 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-57d552ac-77bc-496a-8008-5132524a1dea req-48500a38-fed5-4ca8-9d94-085cf75d482d service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2638404 Nov 15 17:49:00.058005 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.060081 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-28053e3b-c503-4fc3-b691-958a29460165 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.064861 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-28053e3b-c503-4fc3-b691-958a29460165 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.105759 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-28053e3b-c503-4fc3-b691-958a29460165 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=92203f0e66304ce695e177fa78e6525a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4693911 Nov 15 17:49:00.107038 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28053e3b-c503-4fc3-b691-958a29460165 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=427a96f3-81db-4b5b-8399-b44ffcc1e840,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.108619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53004) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:00.140681 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.143334 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.144496 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/a66b9318-76a0-4946-a41a-177acd041550 HTTP/1.1" status: 204 len: 168 time: 0.2583036 Nov 15 17:49:00.158788 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.161436 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.165232 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/888f891d-9228-4348-887c-c95920678fb7 HTTP/1.1" status: 204 len: 168 time: 0.2876575 Nov 15 17:49:00.180893 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4669e7bd-dbaf-4a2a-aefb-f7894097d785 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a66b9318-76a0-4946-a41a-177acd041550,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.235307 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a05bc42-399e-4a07-b329-ef66cb10cfbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=888f891d-9228-4348-887c-c95920678fb7,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.244601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.288162 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ff3f9e-4448-4e7a-8142-04adcdd7d9a8 req-483b169c-a8ed-42de-b29a-3e94b3bd85f2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:00.290018 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0ff3f9e-4448-4e7a-8142-04adcdd7d9a8 req-483b169c-a8ed-42de-b29a-3e94b3bd85f2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.1108389 Nov 15 17:49:00.292139 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.369979 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0ff3f9e-4448-4e7a-8142-04adcdd7d9a8 req-a6a5f24c-227e-4488-b742-857e2a45fa7f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672996 Nov 15 17:49:00.394614 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.394614 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.394614 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/427a96f3-81db-4b5b-8399-b44ffcc1e840 HTTP/1.1" status: 204 len: 168 time: 0.2817125 Nov 15 17:49:00.400438 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bba7fc4-8397-48f0-8408-44f1287f60ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=427a96f3-81db-4b5b-8399-b44ffcc1e840,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.552247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53024) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:00.569297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-286c2197-2032-4f64-9528-4694cc811d80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.581224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53026) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:00.594769 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-11a78df0-431b-468f-9bf5-5a7b2a758799 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.665559 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f81b611a-4de9-4830-944c-c17c90ae0fc8 req-32c8ff53-8a63-48aa-b63e-11febc9754b5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:00.667829 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f81b611a-4de9-4830-944c-c17c90ae0fc8 req-32c8ff53-8a63-48aa-b63e-11febc9754b5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0889070 Nov 15 17:49:00.677695 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-11a78df0-431b-468f-9bf5-5a7b2a758799 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.682276 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-11a78df0-431b-468f-9bf5-5a7b2a758799 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.726371 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-11a78df0-431b-468f-9bf5-5a7b2a758799 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8bd4488d7f104081b6a306184e9db5d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1404059 Nov 15 17:49:00.726371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a78df0-431b-468f-9bf5-5a7b2a758799 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae4477c3-d0c8-45ae-a96c-07261abfd08f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.726371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53028) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:00.748053 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-286c2197-2032-4f64-9528-4694cc811d80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.752227 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f81b611a-4de9-4830-944c-c17c90ae0fc8 req-0b02cffa-9b35-406f-b2a0-47f9874ba0a0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775924 Nov 15 17:49:00.756313 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-286c2197-2032-4f64-9528-4694cc811d80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.792752 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.800288 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286c2197-2032-4f64-9528-4694cc811d80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9de3c63c-804a-40ab-8114-3369967829a5,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.801672 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3bdfaf9e-9c13-4128-9b87-5fa7036832b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.838314 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-286c2197-2032-4f64-9528-4694cc811d80 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=607eadaabc924920b1826205b15f8f8c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2847598 Nov 15 17:49:00.840829 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53032) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:00.844699 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.892815 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.893992 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.897143 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.898448 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ae4477c3-d0c8-45ae-a96c-07261abfd08f HTTP/1.1" status: 204 len: 168 time: 0.1705496 Nov 15 17:49:00.912416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17270e91-6c58-4ed7-aa37-b47839f51039 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae4477c3-d0c8-45ae-a96c-07261abfd08f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:00.920693 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.977346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.980163 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:00.981375 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9de3c63c-804a-40ab-8114-3369967829a5 HTTP/1.1" status: 204 len: 168 time: 0.1395814 Nov 15 17:49:00.989793 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096241cc-f5cc-4b1f-baa5-84581c247d91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9de3c63c-804a-40ab-8114-3369967829a5,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:01.053549 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53040) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:01.067502 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-56a1964c-8290-4416-9480-015381b0f24a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.147529 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-56a1964c-8290-4416-9480-015381b0f24a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.153478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-56a1964c-8290-4416-9480-015381b0f24a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.204963 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-56a1964c-8290-4416-9480-015381b0f24a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=0dac9c6c841949d89ef6a41935b5ee04&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1502292 Nov 15 17:49:01.205103 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53046) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:01.206200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a1964c-8290-4416-9480-015381b0f24a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35c45761-5c25-41dc-aad4-501f2dbbfbbb,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:01.267512 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.290633 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.363615 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.366981 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:01.369082 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/35c45761-5c25-41dc-aad4-501f2dbbfbbb HTTP/1.1" status: 204 len: 168 time: 0.1619122 Nov 15 17:49:01.383346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a7d5602-d103-4940-a7ca-da8c5fe95967 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35c45761-5c25-41dc-aad4-501f2dbbfbbb,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:01.555249 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5fd8b84-d2fd-47aa-8c56-1b7a475a1911 req-4fe86537-2e9a-4fe7-b439-5f83b94b62d6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:01.557968 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5fd8b84-d2fd-47aa-8c56-1b7a475a1911 req-4fe86537-2e9a-4fe7-b439-5f83b94b62d6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0883307 Nov 15 17:49:01.624712 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5fd8b84-d2fd-47aa-8c56-1b7a475a1911 req-69bb4b5a-be66-440c-b0f0-8fc9f6151090 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600066 Nov 15 17:49:01.937597 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-504e11d9-ec0b-4fc9-ac4e-377990103244 req-1e757125-ab33-43c6-bfe6-85efbf627929 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:01.939135 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-504e11d9-ec0b-4fc9-ac4e-377990103244 req-1e757125-ab33-43c6-bfe6-85efbf627929 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0530858 Nov 15 17:49:01.992642 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-504e11d9-ec0b-4fc9-ac4e-377990103244 req-df37c2f2-9499-4528-b6be-8c7a2bc0c159 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458944 Nov 15 17:49:02.781617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2079c4-b925-487b-a624-eda1642dd424 req-92d1353f-bae0-4451-ad36-476aa348167f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:02.793960 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e2079c4-b925-487b-a624-eda1642dd424 req-92d1353f-bae0-4451-ad36-476aa348167f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0817206 Nov 15 17:49:02.864309 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e2079c4-b925-487b-a624-eda1642dd424 req-4c78bfdd-c330-4b86-9d9e-2ceae1fae920 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693748 Nov 15 17:49:02.995000 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7946b20-f663-4bd2-bae8-ff7b0b2290a7 req-aced1393-5195-42de-ac8f-2985c2c74da4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:02.996778 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b7946b20-f663-4bd2-bae8-ff7b0b2290a7 req-aced1393-5195-42de-ac8f-2985c2c74da4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0556233 Nov 15 17:49:03.005607 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53170) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:03.011303 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'floatingip': {'port_id': '292c8c58-e8da-4843-ba3f-a998315a35b0'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:03.078545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e51c8bf9-1168-4cbd-9cea-6b440372b8bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.175016 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7ad9f4-7c59-46bb-b030-5bbfe324521e req-868a4a9e-1871-457e-af6d-a26c58e263b2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:03.183402 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fb7ad9f4-7c59-46bb-b030-5bbfe324521e req-868a4a9e-1871-457e-af6d-a26c58e263b2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0618732 Nov 15 17:49:03.187625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.246358 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fb7ad9f4-7c59-46bb-b030-5bbfe324521e req-86bc7426-378e-4b2a-8b13-0dc3c0c539a8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620234 Nov 15 17:49:03.273588 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53186) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:03.486642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b936e41-7325-4172-9b7b-7b279ec434fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.610882 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b936e41-7325-4172-9b7b-7b279ec434fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.617095 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b936e41-7325-4172-9b7b-7b279ec434fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.657617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b936e41-7325-4172-9b7b-7b279ec434fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0e2c5f8-5a52-40b0-b975-fc6a2dbbc00f,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:03.662142 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6b936e41-7325-4172-9b7b-7b279ec434fc admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=af6d936cc30546e1ab1f4ece5907050c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3871078 Nov 15 17:49:03.666414 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53196) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:03.713983 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.734658 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.783373 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.785973 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.787135 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/a0e2c5f8-5a52-40b0-b975-fc6a2dbbc00f HTTP/1.1" status: 204 len: 168 time: 0.1201425 Nov 15 17:49:03.796154 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d648946c-60c9-4a78-a5a0-3d8aec1dc335 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0e2c5f8-5a52-40b0-b975-fc6a2dbbc00f,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:03.816492 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.823277 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:03.928184 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Floating IP 46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72 associated. External IP: 172.27.0.223, port: 292c8c58-e8da-4843-ba3f-a998315a35b0. Nov 15 17:49:04.160431 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:49:04.391968 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c151debe-c24b-49d4-84a9-9ab05110dca0 req-6d94316f-0696-4639-9c69-05bb17d15dab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:04.393462 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c151debe-c24b-49d4-84a9-9ab05110dca0 req-6d94316f-0696-4639-9c69-05bb17d15dab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0577788 Nov 15 17:49:04.460602 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:04.461886 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c151debe-c24b-49d4-84a9-9ab05110dca0 req-69e6df80-88b9-4c9a-b35a-95a8a95015f0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619323 Nov 15 17:49:04.480717 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:49:04.487022 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:04.498036 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:49:04.519934 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:04.520445 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:04.525361 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a1bb6f10-f43c-4309-b984-d55ac5f9c809 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "PUT /v2.0/floatingips/46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72 HTTP/1.1" status: 200 len: 992 time: 1.5185747 Nov 15 17:49:04.526218 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:04.529068 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1df6933-2039-411e-b6bf-38f2d4377ed5" -d '{"events": [{"name": "network-changed", "server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:04.611226 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f16736b1-342b-47c8-9a41-75dbca61eaa1 x-openstack-request-id: req-f16736b1-342b-47c8-9a41-75dbca61eaa1 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:04.611518 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:04.611807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f16736b1-342b-47c8-9a41-75dbca61eaa1 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:04.612207 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'status': 'completed', 'code': 200} Nov 15 17:49:04.679374 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:04.951030 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.223', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:11:aa:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:48:38Z', 'updated_at': '2021-11-15T17:49:03Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:04.982334 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:49:04.991115 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:04.991862 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:05.114589 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:05.427312 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.223', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:11:aa:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:48:38Z', 'updated_at': '2021-11-15T17:49:03Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:05.452592 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfd72d28-23e1-4214-a9a7-3ae6a4553b2d None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.223', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:11:aa:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:48:38Z', 'updated_at': '2021-11-15T17:49:03Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:49:05.590924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea69fe49-ef8f-4441-b7b5-5737e9dd34a3 req-cb9baed8-a236-4130-b2d5-ad2c0a1ea41f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:05.599157 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ea69fe49-ef8f-4441-b7b5-5737e9dd34a3 req-cb9baed8-a236-4130-b2d5-ad2c0a1ea41f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0627706 Nov 15 17:49:05.618875 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:05.658875 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ea69fe49-ef8f-4441-b7b5-5737e9dd34a3 req-77dde04d-a637-4171-bcba-29ac1ff76d9e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575426 Nov 15 17:49:05.696523 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1c059f9-ce71-440e-a146-facdad73746c None None] New status for floating IP 46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72: ACTIVE {{(pid=108143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:49:06.657853 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:06.771097 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ca90b4-ed8e-4130-893d-750906eecf2b req-4a4ac547-8da6-4a36-beab-b4762f426c0c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:06.772765 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b2ca90b4-ed8e-4130-893d-750906eecf2b req-4a4ac547-8da6-4a36-beab-b4762f426c0c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0507812 Nov 15 17:49:06.829866 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b2ca90b4-ed8e-4130-893d-750906eecf2b req-142e102e-9a43-4128-8232-c33f48f231eb tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495594 Nov 15 17:49:06.862528 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53334) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:06.967685 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cd6388ce-5741-47c6-8f00-7e8edf02c1f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.044425 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cd6388ce-5741-47c6-8f00-7e8edf02c1f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.049928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-cd6388ce-5741-47c6-8f00-7e8edf02c1f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.088371 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6388ce-5741-47c6-8f00-7e8edf02c1f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11977cc8-bb44-436f-8f34-21c97f1b635a,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:07.092737 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-cd6388ce-5741-47c6-8f00-7e8edf02c1f1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=3b2a5e7fb729423a98c802cba8a7234f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2291057 Nov 15 17:49:07.095295 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53342) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:07.144593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.165630 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.212451 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.215092 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.216280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/11977cc8-bb44-436f-8f34-21c97f1b635a HTTP/1.1" status: 204 len: 168 time: 0.1200604 Nov 15 17:49:07.224513 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f31916-1d3c-4470-ac38-de6ba3ba7fb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11977cc8-bb44-436f-8f34-21c97f1b635a,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:07.504076 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53354) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:07.518093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74426e18-8f7f-435f-9ace-c7473e969362 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.612547 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-e21c4d6b-ea32-4568-9aae-4b30bf210527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:07.614078 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-e21c4d6b-ea32-4568-9aae-4b30bf210527 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1099 time: 0.0650220 Nov 15 17:49:07.648931 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74426e18-8f7f-435f-9ace-c7473e969362 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.677458 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74426e18-8f7f-435f-9ace-c7473e969362 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.731904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74426e18-8f7f-435f-9ace-c7473e969362 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fa56728-9efb-4d8c-ae71-8625fb986079,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:07.736086 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-74426e18-8f7f-435f-9ace-c7473e969362 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8031666500a24fa99eaab033d58efd86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2309587 Nov 15 17:49:07.739099 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53356) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:07.757691 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-cdfd0414-e50b-4d05-a4a3-ea2ad27de809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:07.759233 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-cdfd0414-e50b-4d05-a4a3-ea2ad27de809 service neutron] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 912 time: 0.1349289 Nov 15 17:49:07.791132 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.812158 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.867042 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-f6ea1828-19d2-441c-a46c-77477830e11c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 1002 time: 0.0975790 Nov 15 17:49:07.874457 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.877293 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:07.880223 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9fa56728-9efb-4d8c-ae71-8625fb986079 HTTP/1.1" status: 204 len: 168 time: 0.1399970 Nov 15 17:49:07.895884 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52888587-a4ef-4c36-b482-1532535f201d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fa56728-9efb-4d8c-ae71-8625fb986079,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:07.925273 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-acf56707-2f3b-48d6-ab40-df380785207b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:07.926794 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-acf56707-2f3b-48d6-ab40-df380785207b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0510552 Nov 15 17:49:07.964244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1afbff-5d59-4748-90cd-62a64b6f12d4 req-bfed7699-9774-40bf-8b27-bb37a61d3631 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:07.971490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eb1afbff-5d59-4748-90cd-62a64b6f12d4 req-bfed7699-9774-40bf-8b27-bb37a61d3631 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0581727 Nov 15 17:49:07.974758 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-9a062f4c-9d70-4d6a-9f33-c468a2c29d09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:07.976452 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-9a062f4c-9d70-4d6a-9f33-c468a2c29d09 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412760 Nov 15 17:49:08.019194 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eb1afbff-5d59-4748-90cd-62a64b6f12d4 req-0579d295-86ac-4099-b717-b2b771e4e359 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462914 Nov 15 17:49:08.080451 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-892e2e68-82b5-44bc-9abe-50a8337272ec service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960088 Nov 15 17:49:08.188387 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e1df6933-2039-411e-b6bf-38f2d4377ed5 req-ec26f13c-4fe4-4197-a7c7-0774743d6a09 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0996728 Nov 15 17:49:09.167727 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9c5128-8d75-4cd7-bb1e-303e1d146205 req-ed6a9951-b27a-421c-adc2-75f2fa8c552d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:09.169245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa9c5128-8d75-4cd7-bb1e-303e1d146205 req-ed6a9951-b27a-421c-adc2-75f2fa8c552d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0509233 Nov 15 17:49:09.217245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa9c5128-8d75-4cd7-bb1e-303e1d146205 req-345ce07e-05c3-47f5-9d5b-3c9ff9f5f801 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420363 Nov 15 17:49:10.363985 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a3dba9-c307-47ca-bbde-99152da34458 req-302ada81-440d-4122-9e31-1208e1986e57 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:10.365930 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b1a3dba9-c307-47ca-bbde-99152da34458 req-302ada81-440d-4122-9e31-1208e1986e57 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0643744 Nov 15 17:49:10.414497 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b1a3dba9-c307-47ca-bbde-99152da34458 req-aeeee407-3c79-4257-aa67-9b78863885e2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421238 Nov 15 17:49:11.538747 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c519eb-b1d4-40e4-994e-77d3b89f2e49 req-41a799ea-10c8-4874-a23e-162d28626600 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:11.540289 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d4c519eb-b1d4-40e4-994e-77d3b89f2e49 req-41a799ea-10c8-4874-a23e-162d28626600 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0562882 Nov 15 17:49:11.590867 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d4c519eb-b1d4-40e4-994e-77d3b89f2e49 req-fceb9556-5a7c-4754-b45f-27e3cb9555a3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437624 Nov 15 17:49:12.718994 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad9bb33-98c3-4e45-8844-66746eb87e6d req-169d4a1e-5fac-4a53-ad59-24e8a8822f8c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:12.720680 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2ad9bb33-98c3-4e45-8844-66746eb87e6d req-169d4a1e-5fac-4a53-ad59-24e8a8822f8c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0564096 Nov 15 17:49:12.789994 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2ad9bb33-98c3-4e45-8844-66746eb87e6d req-2979937c-25b7-4802-b5a7-45875ac27f62 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546441 Nov 15 17:49:13.946005 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75816354-354b-4b47-8625-21aaa46bd504 req-bc291ce6-518e-4da5-be69-58f7cd291697 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:13.948742 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75816354-354b-4b47-8625-21aaa46bd504 req-bc291ce6-518e-4da5-be69-58f7cd291697 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0537665 Nov 15 17:49:14.007572 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75816354-354b-4b47-8625-21aaa46bd504 req-90cad085-a183-4586-801a-bba38d116d95 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516565 Nov 15 17:49:14.184893 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-7c31935f-68a2-49ef-ad9a-83a2129ab054 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:14.186657 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-7c31935f-68a2-49ef-ad9a-83a2129ab054 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.1641254 Nov 15 17:49:14.202380 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-d32b9dc8-83cf-41d9-b7a9-75058f1b1d8c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/quotas/cdb494aa542c4eff8e62f9dd653bde82 HTTP/1.1" status: 200 len: 375 time: 0.0098531 Nov 15 17:49:14.255188 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-2de2d6ce-5556-4abd-9feb-eaac75b1d37a tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0468132 Nov 15 17:49:14.350703 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-40d05a81-1189-4c53-a88f-6b835e26d7be service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876441 Nov 15 17:49:14.442800 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-be9bba89-3393-4b1e-9558-f72218b16210 service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856392 Nov 15 17:49:14.618529 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7298f584-009b-47d1-bf7e-fc6376457523 req-bc6e84fe-ef40-4ec6-bd0b-244b3a92e5c2 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 210 time: 0.0275440 Nov 15 17:49:15.140355 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c89fb-76e2-4da7-8034-a74c3e0ca631 req-6f76449a-85ef-4333-9d65-787920140b44 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:15.141844 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-990c89fb-76e2-4da7-8034-a74c3e0ca631 req-6f76449a-85ef-4333-9d65-787920140b44 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0555525 Nov 15 17:49:15.421264 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-990c89fb-76e2-4da7-8034-a74c3e0ca631 req-b6c6f603-6b91-4944-be35-07d7c61e9114 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2659612 Nov 15 17:49:15.714955 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53656) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:15.775959 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-83871bd9-d91a-4076-a078-ba44b334fb17 req-10add311-9cbe-4f43-be40-1afe3f858fc9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 210 time: 0.0401154 Nov 15 17:49:15.886875 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:15.983783 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-974ece6f-b753-4912-bc2d-b025a0d370c3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:15.985344 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-974ece6f-b753-4912-bc2d-b025a0d370c3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.1674592 Nov 15 17:49:16.026567 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.031148 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.071897 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ca8e7c157cd942adbbf4280294d6a788&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3557706 Nov 15 17:49:16.072848 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23ee988b-084c-404e-b723-b0696680f291,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:16.074780 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53666) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:16.080451 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.080828 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.081172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.081540 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.081933 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.082172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.082514 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.082827 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.083152 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.083465 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.083808 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.084199 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f4c747f-cf77-449a-a3bc-2f3675dfa45b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.144234 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.166191 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.214927 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.217803 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.219007 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/23ee988b-084c-404e-b723-b0696680f291 HTTP/1.1" status: 204 len: 168 time: 0.1430540 Nov 15 17:49:16.227634 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23ee988b-084c-404e-b723-b0696680f291,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:16.236900 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.237234 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.237611 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.237931 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.238220 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.238571 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.238892 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.239227 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.239639 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.239891 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.240200 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.240483 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7939d546-d5a4-4cc1-b2be-015882c65a42 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:16.521093 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53682) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:16.536981 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4ac7139d-f2ca-4960-808c-9a2f6d132a2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.566385 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813f71e9-d7e9-4e20-8f24-c8b85bbbf480 req-3b286e12-e52d-41f5-adfa-7c4ccc1f3638 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:16.567937 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-813f71e9-d7e9-4e20-8f24-c8b85bbbf480 req-3b286e12-e52d-41f5-adfa-7c4ccc1f3638 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0770156 Nov 15 17:49:16.643427 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-813f71e9-d7e9-4e20-8f24-c8b85bbbf480 req-ad4201f1-7851-4391-a8bc-bd31e4a18dcc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666263 Nov 15 17:49:16.667070 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4ac7139d-f2ca-4960-808c-9a2f6d132a2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.671802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4ac7139d-f2ca-4960-808c-9a2f6d132a2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.708968 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac7139d-f2ca-4960-808c-9a2f6d132a2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b797b2e-3dc6-4777-80ff-e22c876ab9ee,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:16.716617 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4ac7139d-f2ca-4960-808c-9a2f6d132a2b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a6114ff3299e4fc8aad35e91d35a6cd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1916008 Nov 15 17:49:16.716617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53696) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:16.765822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.788164 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.849191 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.853194 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:16.854735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7b797b2e-3dc6-4777-80ff-e22c876ab9ee HTTP/1.1" status: 204 len: 168 time: 0.1375434 Nov 15 17:49:16.865578 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5008ec-1d76-4aff-ba7d-189cc01b4fb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b797b2e-3dc6-4777-80ff-e22c876ab9ee,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:16.913156 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e9a6fc9e-492a-4603-87fb-b32127d21568 req-1fb01752-9dd4-4f40-baa2-88f636f98e90 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 210 time: 0.0417535 Nov 15 17:49:17.581598 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53746) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:17.688096 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1138066612-network', 'tenant_id': '1cfb619502ff4caf9d8eac915d65cf45'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:17.712564 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Made reservation on behalf of 1cfb619502ff4caf9d8eac915d65cf45 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:17.715019 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.732596 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.789099 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3248dcbe-23d8-493d-af08-281e8284dfcb req-36b1d39f-ad59-4ed9-b055-64a49feae06b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:17.790685 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3248dcbe-23d8-493d-af08-281e8284dfcb req-36b1d39f-ad59-4ed9-b055-64a49feae06b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0734947 Nov 15 17:49:17.871546 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3248dcbe-23d8-493d-af08-281e8284dfcb req-c00df286-1ff2-4be7-a840-66de01692f84 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747764 Nov 15 17:49:17.875941 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.880980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.907092 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] vlan segment allocate from pool success with {'vlan_id': 429, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:49:17.917182 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b96be19f-c793-448f-a182-0a226920ef47,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:17.922028 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.922363 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Added segment e56b7ebc-26de-4041-8846-3a17739fefb7 of type vlan for network 8f819556-4c31-4add-a5a8-03cdf64edfa2 Nov 15 17:49:17.961601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.994515 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:17.995735 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:17.996333 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.016589 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e3de81b-08f9-4c84-bc33-a3c3cc243bb9 req-3bd6b148-d96d-456a-8845-df6ab7218c58 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 210 time: 0.0341475 Nov 15 17:49:18.060744 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4779897 Nov 15 17:49:18.063921 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53758) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:18.068969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Request body: {'subnet': {'network_id': '8f819556-4c31-4add-a5a8-03cdf64edfa2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1138066612-subnet', 'tenant_id': '1cfb619502ff4caf9d8eac915d65cf45', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:18.076493 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bff1812-48bd-400e-b464-75328bdd612a admin admin] Pushing event updated for resources: {'Network': ['ID=8f819556-4c31-4add-a5a8-03cdf64edfa2,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:18.088767 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 8f819556-4c31-4add-a5a8-03cdf64edfa2 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:49:18.097173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Made reservation on behalf of 1cfb619502ff4caf9d8eac915d65cf45 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:18.099875 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.266123 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.329654 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Pushing event updated for resources: {'Subnet': ['ID=200df6ca-bf0e-4c64-866c-ceb13bac4785,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:18.340056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Checking segment: {'id': 'e56b7ebc-26de-4041-8846-3a17739fefb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': '8f819556-4c31-4add-a5a8-03cdf64edfa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:18.340401 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Network hostable DHCP agents. Network: 8f819556-4c31-4add-a5a8-03cdf64edfa2, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:49:18.358030 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Network 8f819556-4c31-4add-a5a8-03cdf64edfa2 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:49:18.367240 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 8f819556-4c31-4add-a5a8-03cdf64edfa2) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:18.371832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:18.372410 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.377315 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-699e56ec-b50f-4f90-a767-433bf29c5efb None None] Network 8f819556-4c31-4add-a5a8-03cdf64edfa2 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:18.389696 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b8042503-6989-4352-9bfe-47b9d7253d06 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3246260 Nov 15 17:49:18.504980 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17b0011b-70d7-42fa-94a5-38a05ae28f61 None None] Network 8f819556-4c31-4add-a5a8-03cdf64edfa2 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:18.870198 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 53782) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:18.882060 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-945047388-network', 'tenant_id': '59287bc5adcb4409b0c01786d302440a'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:18.913879 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Made reservation on behalf of 59287bc5adcb4409b0c01786d302440a for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:18.916554 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.925891 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:18.959536 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Request body: {'port': {'device_id': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'admin_state_up': True, 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:19.036643 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6eb739-241c-47ee-a707-31345d23a2ed req-d434f668-9057-4016-b7b2-24aa38b53933 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.038121 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dd6eb739-241c-47ee-a707-31345d23a2ed req-d434f668-9057-4016-b7b2-24aa38b53933 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0705786 Nov 15 17:49:19.072706 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.084824 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.107011 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-d2186e5c-184d-4392-bbf2-1a50fca6e113 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1009252 Nov 15 17:49:19.122200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:19.126692 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.156511 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-09a16e19-5dea-4115-9010-74f8d1c185d9 req-aae62b81-faba-4be3-8976-442b1fde3fb6 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 210 time: 0.0549302 Nov 15 17:49:19.159977 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dd6eb739-241c-47ee-a707-31345d23a2ed req-21f64f22-cb7b-4414-9447-1409bad1f297 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137440 Nov 15 17:49:19.160967 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] vlan segment allocate from pool success with {'vlan_id': 425, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:49:19.163230 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ca482e1-e7eb-4818-bfd0-22ff88407081,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:19.188524 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.188944 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Added segment aa3ebc57-cb0e-47fd-ab57-1cdcb6fb57c5 of type vlan for network 29e676da-b0e2-4ebb-89c5-cff94d58f703 Nov 15 17:49:19.230027 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.255045 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.256127 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.256724 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.276587 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-55f447da-f4ae-42e7-a991-c2000f2d2ba5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.278077 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-55f447da-f4ae-42e7-a991-c2000f2d2ba5 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=04f55f51f2b5414d837b134a5c85985c&device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 1098 time: 0.0825760 Nov 15 17:49:19.296304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Allocated IP 172.20.0.13 (3919dfc4-3e42-4144-97e7-2ccb5146f2a2/c6a2eeae-0fac-4586-be17-093ae2e28ec5/51f77003-54ff-44ef-a4c0-98da6c460703) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:19.309378 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4346883 Nov 15 17:49:19.310804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 53794) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:19.315625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Request body: {'subnet': {'network_id': '29e676da-b0e2-4ebb-89c5-cff94d58f703', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-945047388-subnet', 'tenant_id': '59287bc5adcb4409b0c01786d302440a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:19.317816 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f4b659-b335-40c8-9701-3070977dd093 admin admin] Pushing event updated for resources: {'Network': ['ID=29e676da-b0e2-4ebb-89c5-cff94d58f703,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:19.329274 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 29e676da-b0e2-4ebb-89c5-cff94d58f703 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:49:19.427507 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Made reservation on behalf of 59287bc5adcb4409b0c01786d302440a for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:19.429883 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.534974 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-7363b579-332d-4cfa-ba07-2d716442247b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.536461 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-7363b579-332d-4cfa-ba07-2d716442247b service neutron] 10.222.0.48 "GET /v2.0/networks?id=c6711a21-f84e-4a09-b311-4dc71011fb84 HTTP/1.1" status: 200 len: 913 time: 0.2156274 Nov 15 17:49:19.603381 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.702629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.733836 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.778214 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:19.785829 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:19.794084 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:19.796522 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event updated for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:19.850516 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dbb3fa0e-8892-4a52-bfe0-fb11e9bd0e6e,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:19.866175 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.866774 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.872503 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Checking segment: {'id': 'aa3ebc57-cb0e-47fd-ab57-1cdcb6fb57c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '29e676da-b0e2-4ebb-89c5-cff94d58f703'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:19.872847 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Network hostable DHCP agents. Network: 29e676da-b0e2-4ebb-89c5-cff94d58f703, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:49:19.891846 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b6997bee-b863-4778-9607-9d9f46530aef tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9371371 Nov 15 17:49:19.898556 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Network 29e676da-b0e2-4ebb-89c5-cff94d58f703 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:49:19.908575 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 29e676da-b0e2-4ebb-89c5-cff94d58f703) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:19.913263 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:19.913696 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:19.920536 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1d5c65e-e9c4-4d7d-b692-81f3afa91d08 None None] Network 29e676da-b0e2-4ebb-89c5-cff94d58f703 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:19.934422 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-2afcd608-ec2b-4899-affa-a83c735653d6 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6219068 Nov 15 17:49:20.074060 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dec8b01b-bd4c-4f77-bf83-39b3b605f5e2 None None] Network 29e676da-b0e2-4ebb-89c5-cff94d58f703 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:20.285688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cc9872-e9a4-40ac-9a01-c32ca497f27d req-447c2c24-ffab-427d-b219-09d28166fcf1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:20.287191 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-14cc9872-e9a4-40ac-9a01-c32ca497f27d req-447c2c24-ffab-427d-b219-09d28166fcf1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 932 time: 0.0546453 Nov 15 17:49:20.339821 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-14cc9872-e9a4-40ac-9a01-c32ca497f27d req-158d2ee4-1156-4754-b3a9-12b8178c5afb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463896 Nov 15 17:49:20.445801 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cde2983-20d8-4991-9b60-6862b105e128 req-299bf78b-a035-4ef2-8c1d-de9c3f016a95 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:20.447415 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5cde2983-20d8-4991-9b60-6862b105e128 req-299bf78b-a035-4ef2-8c1d-de9c3f016a95 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0511498 Nov 15 17:49:20.503838 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5cde2983-20d8-4991-9b60-6862b105e128 req-bc9d04dd-e6eb-4691-ab19-e93ff8b08ee3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504525 Nov 15 17:49:21.046729 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:49:21.183235 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:21.218025 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-ff38dcb4-7847-4114-a5fa-a563facba221 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98 HTTP/1.1" status: 200 len: 217 time: 0.0337973 Nov 15 17:49:21.453601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb04bd0-d041-4391-80ad-5b5abbc96095 req-da296077-c4d3-46d4-b6ca-3282bba01c43 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:21.455065 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-feb04bd0-d041-4391-80ad-5b5abbc96095 req-da296077-c4d3-46d4-b6ca-3282bba01c43 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 932 time: 0.0486958 Nov 15 17:49:21.506891 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-feb04bd0-d041-4391-80ad-5b5abbc96095 req-936b68db-ce43-4db4-b2be-27b293239c71 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457842 Nov 15 17:49:21.621753 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f83d5f3-4c85-4b50-aa31-f490ce8f5bb2 req-67cdb5b3-26cd-412f-8d51-2fdb1608c331 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:21.623195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5f83d5f3-4c85-4b50-aa31-f490ce8f5bb2 req-67cdb5b3-26cd-412f-8d51-2fdb1608c331 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0509593 Nov 15 17:49:21.683043 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5f83d5f3-4c85-4b50-aa31-f490ce8f5bb2 req-bb5a7e09-2be8-42ba-8df8-345e32e091f0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511744 Nov 15 17:49:22.264756 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Request body: {'port': {'device_id': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:22.291413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:22.351612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-b532e1ec-6286-48ce-90cc-9b5c054e29c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:22.353714 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-b532e1ec-6286-48ce-90cc-9b5c054e29c9 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=28e89ccf-c78a-4f2e-be95-0646f1dfc889 HTTP/1.1" status: 200 len: 852 time: 0.0857329 Nov 15 17:49:22.360066 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:22.396077 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-38a1f031-feab-467a-8663-7fdad1979cc2 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c6711a21-f84e-4a09-b311-4dc71011fb84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0277514 Nov 15 17:49:22.613648 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-71e5ea2d-4c35-4486-96ad-3029b23745a9 service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2012038 Nov 15 17:49:22.638409 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6754a1fb-701d-470b-a78d-35ae65047974 req-08bf7a69-42ff-4a48-9ddb-496fcf23f125 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:22.639947 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6754a1fb-701d-470b-a78d-35ae65047974 req-08bf7a69-42ff-4a48-9ddb-496fcf23f125 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 932 time: 0.0591593 Nov 15 17:49:22.693954 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6754a1fb-701d-470b-a78d-35ae65047974 req-f04d5db4-bfe3-472e-a34f-af233b9e0614 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472953 Nov 15 17:49:22.771580 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-52692473-9e2d-4c84-a9b8-648ed0439655 req-50410240-cc41-4f1a-a017-c5668762ced5 service neutron] 10.222.0.48 "GET /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1491919 Nov 15 17:49:22.810041 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1355ce6a-4e0b-46d1-99e5-6d4dff3d5f89 req-25173a1b-970a-4842-b493-2fb357942a73 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:22.810426 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 51f77003-54ff-44ef-a4c0-98da6c460703 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:22.811495 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1355ce6a-4e0b-46d1-99e5-6d4dff3d5f89 req-25173a1b-970a-4842-b493-2fb357942a73 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0554743 Nov 15 17:49:22.819428 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:22.832044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Transition to ACTIVE for port object 51f77003-54ff-44ef-a4c0-98da6c460703 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:49:22.836883 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:22.860843 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1355ce6a-4e0b-46d1-99e5-6d4dff3d5f89 req-98d095e7-72d0-4d1c-abe8-02fdc32aa0ba tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424588 Nov 15 17:49:22.903874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Pushing event updated for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:22.950587 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Attempting to bind port 51f77003-54ff-44ef-a4c0-98da6c460703 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:22.950951 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Attempting to bind port 51f77003-54ff-44ef-a4c0-98da6c460703 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:22.951366 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Attempting to bind port 51f77003-54ff-44ef-a4c0-98da6c460703 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:22.955716 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Port 51f77003-54ff-44ef-a4c0-98da6c460703 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:49:22.956042 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Attempting to bind port 51f77003-54ff-44ef-a4c0-98da6c460703 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:22.960746 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:22.961069 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Checking segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:22.961448 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Bound using segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:22.961865 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Bound port: 51f77003-54ff-44ef-a4c0-98da6c460703, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:22.962219 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:23.025783 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:23.028778 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=51f77003-54ff-44ef-a4c0-98da6c460703,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:23.034288 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:23.070263 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:23.070879 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:23.072499 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] 10.222.0.48 "PUT /v2.0/ports/51f77003-54ff-44ef-a4c0-98da6c460703 HTTP/1.1" status: 200 len: 1094 time: 0.8120868 Nov 15 17:49:23.073050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:23.076269 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a400cc80-6778-44e1-8ca9-9ec94e28a061" -d '{"events": [{"name": "network-changed", "server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:23.096335 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b11aba4b-bd8f-4337-a8ba-c3060e3c4f54 service neutron] Pushing event updated for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:23.113841 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-785be99d-1e8d-4cca-bce8-49ed8ba4c689 x-openstack-request-id: req-785be99d-1e8d-4cca-bce8-49ed8ba4c689 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:23.114151 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:23.114396 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-785be99d-1e8d-4cca-bce8-49ed8ba4c689 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:23.114779 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703', 'status': 'completed', 'code': 200} Nov 15 17:49:23.811847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f0d26f-7fc6-400a-85f3-28965e77028a req-d84640a0-e50f-4429-9fd8-5c5b1cb4cbf4 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:23.813322 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-28f0d26f-7fc6-400a-85f3-28965e77028a req-d84640a0-e50f-4429-9fd8-5c5b1cb4cbf4 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0491235 Nov 15 17:49:23.862169 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-28f0d26f-7fc6-400a-85f3-28965e77028a req-b730c0ac-0f42-498e-a406-a681578ec667 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420671 Nov 15 17:49:23.979494 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c1cd14-0d50-4f10-9842-15ced4680eb1 req-05ac3913-032b-45cc-9c22-caaa0df9bc8a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:23.981283 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-65c1cd14-0d50-4f10-9842-15ced4680eb1 req-05ac3913-032b-45cc-9c22-caaa0df9bc8a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0538476 Nov 15 17:49:24.029142 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-65c1cd14-0d50-4f10-9842-15ced4680eb1 req-ff5ee679-2d4a-4ff3-a297-fcd69df8a5d5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419939 Nov 15 17:49:24.983259 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4aa100a-0223-49de-bd0f-377b35b56eea req-e3c3991a-3db9-4eb5-bbd9-476ea579257c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:24.984762 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a4aa100a-0223-49de-bd0f-377b35b56eea req-e3c3991a-3db9-4eb5-bbd9-476ea579257c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0564539 Nov 15 17:49:25.037478 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a4aa100a-0223-49de-bd0f-377b35b56eea req-79f4a59b-aef3-459d-aa43-a8919f2de830 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441864 Nov 15 17:49:25.150419 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabd6a96-c2c9-416a-84ee-2a20d9ae7130 req-ca2e94e8-1a0a-4ccd-8e14-4fb74256dd80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:25.151934 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aabd6a96-c2c9-416a-84ee-2a20d9ae7130 req-ca2e94e8-1a0a-4ccd-8e14-4fb74256dd80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0568113 Nov 15 17:49:25.206783 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aabd6a96-c2c9-416a-84ee-2a20d9ae7130 req-ebc1a9c8-b8e4-4eb5-892e-555e2100597a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461590 Nov 15 17:49:25.901442 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-8f415e1b-8d77-4886-a1cd-93c70dce7b2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:25.903152 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-8f415e1b-8d77-4886-a1cd-93c70dce7b2e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 1097 time: 0.0423853 Nov 15 17:49:26.008893 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-1195d9eb-adea-4824-89e6-33bcd8f5a6fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.010403 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-1195d9eb-adea-4824-89e6-33bcd8f5a6fd service neutron] 10.222.0.48 "GET /v2.0/networks?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0974779 Nov 15 17:49:26.127849 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-756b03e7-7fed-4787-98f3-428acb6210b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.129931 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a400cc80-6778-44e1-8ca9-9ec94e28a061 req-756b03e7-7fed-4787-98f3-428acb6210b5 service neutron] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1090906 Nov 15 17:49:26.170100 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec2cebd-f80f-428a-b038-df7cc4a3717f req-9fa35446-ae42-482c-a916-1efeadf8dfbd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.171635 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ec2cebd-f80f-428a-b038-df7cc4a3717f req-9fa35446-ae42-482c-a916-1efeadf8dfbd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0533674 Nov 15 17:49:26.238365 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-451ba589-a7cb-49a0-89ec-502653877c75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.239631 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ec2cebd-f80f-428a-b038-df7cc4a3717f req-589e9926-9c98-4855-9f0f-ac2d52b6fda9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556371 Nov 15 17:49:26.239893 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-451ba589-a7cb-49a0-89ec-502653877c75 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 1097 time: 0.0508137 Nov 15 17:49:26.286478 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-5b681703-bab1-46b6-98b1-72b4c5c91290 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=51f77003-54ff-44ef-a4c0-98da6c460703 HTTP/1.1" status: 200 len: 217 time: 0.0347433 Nov 15 17:49:26.346125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fde365-3568-4ee8-b522-5b4e89403388 req-8d3f3a24-d267-417d-89fd-158835e23539 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.347641 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-8d3f3a24-d267-417d-89fd-158835e23539 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0469768 Nov 15 17:49:26.360940 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a44572-1f83-4f17-ba0f-f4313bd11e8e req-d1db5e9e-9d85-4d7b-a3d9-720535465ec3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.362490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10a44572-1f83-4f17-ba0f-f4313bd11e8e req-d1db5e9e-9d85-4d7b-a3d9-720535465ec3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0690653 Nov 15 17:49:26.397184 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-7e0af76a-0312-4f5e-869d-37026041190c service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409870 Nov 15 17:49:26.454692 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10a44572-1f83-4f17-ba0f-f4313bd11e8e req-589d384e-d654-41b7-b005-f21492a61018 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818427 Nov 15 17:49:26.471281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218e7543-65b4-418e-a912-9b3ea546bf97 req-97cb00d0-5f3f-4f6a-a02d-d28694e88b24 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:26.480649 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-218e7543-65b4-418e-a912-9b3ea546bf97 req-97cb00d0-5f3f-4f6a-a02d-d28694e88b24 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0986252 Nov 15 17:49:26.512870 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-791c6402-c73f-4147-9eab-247794ae7b59 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1047571 Nov 15 17:49:26.538297 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-218e7543-65b4-418e-a912-9b3ea546bf97 req-cf00859b-74f3-4b0e-8c38-de840b266509 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565162 Nov 15 17:49:26.646700 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-71fde365-3568-4ee8-b522-5b4e89403388 req-44c51a96-3b71-4c42-943b-346b560dd787 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045547 Nov 15 17:49:27.352712 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca8610a-78d0-4dbb-a964-6ac01239547f req-ffeb2f4a-714b-497a-aff0-ddaf75d78c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:27.354404 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eca8610a-78d0-4dbb-a964-6ac01239547f req-ffeb2f4a-714b-497a-aff0-ddaf75d78c22 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0554392 Nov 15 17:49:27.402557 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eca8610a-78d0-4dbb-a964-6ac01239547f req-ac155026-b2bf-4535-ab4a-39de753c23ff tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416729 Nov 15 17:49:27.578212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c25cac2-eb0a-449d-a116-f8b0f6c0d99e req-97ec5a6e-47bc-44eb-9feb-bb5b53128291 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:27.579873 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1c25cac2-eb0a-449d-a116-f8b0f6c0d99e req-97ec5a6e-47bc-44eb-9feb-bb5b53128291 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0509582 Nov 15 17:49:27.671090 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1c25cac2-eb0a-449d-a116-f8b0f6c0d99e req-61a45c98-58ac-4eb7-994b-af3e3f8aa5d7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843015 Nov 15 17:49:27.688201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84e6f82-9659-4881-aed9-5b2e999400a8 req-d46f3c6d-80e7-4898-bc63-6f23dbef3b91 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:27.689716 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e84e6f82-9659-4881-aed9-5b2e999400a8 req-d46f3c6d-80e7-4898-bc63-6f23dbef3b91 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0664749 Nov 15 17:49:27.741393 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e84e6f82-9659-4881-aed9-5b2e999400a8 req-4aa140e2-933d-4428-8433-63bba59e3ef8 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454781 Nov 15 17:49:28.520984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771891ba-647b-4d12-89a5-e70844c4c8e9 req-a5678a94-4c25-4e30-9220-86930d2aa646 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:28.522478 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-771891ba-647b-4d12-89a5-e70844c4c8e9 req-a5678a94-4c25-4e30-9220-86930d2aa646 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0504746 Nov 15 17:49:28.579374 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-771891ba-647b-4d12-89a5-e70844c4c8e9 req-a80e6945-ed69-4135-9352-e84dd91a34c7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481870 Nov 15 17:49:28.803957 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63c5d96-c182-443b-b3ad-1bb577887b5d req-7ff55230-d050-45a9-9cae-213294fd0106 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:28.806239 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b63c5d96-c182-443b-b3ad-1bb577887b5d req-7ff55230-d050-45a9-9cae-213294fd0106 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0604467 Nov 15 17:49:28.898588 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ae48f4-5cd4-48f9-a0a1-f1281a91e8b6 req-606e9a58-dd30-4eb4-8a39-d57e09150f9d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:28.900171 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86ae48f4-5cd4-48f9-a0a1-f1281a91e8b6 req-606e9a58-dd30-4eb4-8a39-d57e09150f9d tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0855174 Nov 15 17:49:28.905089 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b63c5d96-c182-443b-b3ad-1bb577887b5d req-b1e7ef34-5511-4081-aacd-67fb0a1ee9a8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923371 Nov 15 17:49:28.958225 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86ae48f4-5cd4-48f9-a0a1-f1281a91e8b6 req-7b9900de-ee36-4e77-b93a-9824989d08e7 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498135 Nov 15 17:49:29.373038 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54034) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:29.406944 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-abb0484b-ae17-4a04-abdb-c6d18ffcf2d5 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:29.408620 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-abb0484b-ae17-4a04-abdb-c6d18ffcf2d5 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.48 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 945 time: 0.0798573 Nov 15 17:49:29.491665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-81963a5e-0461-48e7-b554-ffe1449ee508 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.592140 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-81963a5e-0461-48e7-b554-ffe1449ee508 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.596738 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-81963a5e-0461-48e7-b554-ffe1449ee508 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.643980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81963a5e-0461-48e7-b554-ffe1449ee508 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6bdd505-9794-44c1-8fe7-d2740c88f91c,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:29.657505 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-81963a5e-0461-48e7-b554-ffe1449ee508 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2923c708c2114a76af13dd6ae15c0790&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2832601 Nov 15 17:49:29.658576 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54050) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:29.762078 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78b09c9-3ef3-4dea-b832-eaa0858e1993 req-130b05bf-c747-434f-b36c-25560978f4ea tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:29.764046 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b78b09c9-3ef3-4dea-b832-eaa0858e1993 req-130b05bf-c747-434f-b36c-25560978f4ea tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0804329 Nov 15 17:49:29.764701 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Deleting port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:49:29.765044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.765385 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.799722 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.853829 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b78b09c9-3ef3-4dea-b832-eaa0858e1993 req-64ccb6fd-03f3-436b-b80f-0df0e8358b9d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788214 Nov 15 17:49:29.859460 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] For port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,segment=NetworkSegment(c9c85cd9-2596-49ad-ac18-9a7fdef83b16),segment_id=c9c85cd9-2596-49ad-ac18-9a7fdef83b16)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:29.860171 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.878753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Calling delete_port for 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:49:29.880651 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.883124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:29.884349 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c6bdd505-9794-44c1-8fe7-d2740c88f91c HTTP/1.1" status: 204 len: 168 time: 0.2213504 Nov 15 17:49:29.909224 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77bcd19-3365-4585-a74b-e612f0737217 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6bdd505-9794-44c1-8fe7-d2740c88f91c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:30.115947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.130348 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['998a7bad-c8ca-4278-93c2-bc9e99bb6c98'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:30.179736 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c9dbec-2a13-4fb5-9d2f-7f066684b4c3 req-38ea52b7-1885-4710-b6da-9e8190e998db tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:30.181596 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59c9dbec-2a13-4fb5-9d2f-7f066684b4c3 req-38ea52b7-1885-4710-b6da-9e8190e998db tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1440310 Nov 15 17:49:30.194830 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b08b72-8e20-41a7-9471-40abf8ce50cd req-ed0401e4-aafa-4e9e-b0a7-859751c6ffb6 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:30.196869 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29b08b72-8e20-41a7-9471-40abf8ce50cd req-ed0401e4-aafa-4e9e-b0a7-859751c6ffb6 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 867 time: 0.1142170 Nov 15 17:49:30.215881 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Pushing event deleted for resources: {'Port': ['ID=998a7bad-c8ca-4278-93c2-bc9e99bb6c98,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:30.254763 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59c9dbec-2a13-4fb5-9d2f-7f066684b4c3 req-389d1cef-630f-4d58-aa89-a859f43c9900 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564544 Nov 15 17:49:30.284917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] No DVR routers for this DVR port 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:49:30.289236 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.295709 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d5f17072-ebe8-4baa-b607-a5cc05effd45 req-a957b782-c2ae-4735-bb32-76de2819e84a tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.48 "DELETE /v2.0/ports/998a7bad-c8ca-4278-93c2-bc9e99bb6c98 HTTP/1.1" status: 204 len: 173 time: 0.8783133 Nov 15 17:49:30.296204 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'name': 'network-vif-deleted', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:30.298762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3ccfce7-456e-425a-9214-0d58b2d31fd8" -d '{"events": [{"server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "name": "network-vif-deleted", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:30.323563 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29b08b72-8e20-41a7-9471-40abf8ce50cd req-0fc2aeff-af13-48bc-a49f-5113c9b59082 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/security-groups?id=52d54288-df95-4dd1-966e-7c26bef58326&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732651 Nov 15 17:49:30.361836 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54450266-7b69-4be4-9172-7580e5ad4112 x-openstack-request-id: req-54450266-7b69-4be4-9172-7580e5ad4112 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:30.362213 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad299796-87ba-48d7-a2b2-8bb03351fd76", "name": "network-vif-deleted", "tag": "998a7bad-c8ca-4278-93c2-bc9e99bb6c98", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:30.362467 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-54450266-7b69-4be4-9172-7580e5ad4112 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:30.362911 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad299796-87ba-48d7-a2b2-8bb03351fd76', 'name': 'network-vif-deleted', 'tag': '998a7bad-c8ca-4278-93c2-bc9e99bb6c98', 'status': 'completed', 'code': 200} Nov 15 17:49:30.417410 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54088) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:30.540119 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa2d8827-dd1a-44b5-90e0-70baec512b70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.617767 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa2d8827-dd1a-44b5-90e0-70baec512b70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.623182 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa2d8827-dd1a-44b5-90e0-70baec512b70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.664609 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-fa2d8827-dd1a-44b5-90e0-70baec512b70 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=36a1a8dd873b4c4aa5f26b692ad5ca41&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2419739 Nov 15 17:49:30.664609 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2d8827-dd1a-44b5-90e0-70baec512b70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8885f86-6a96-4f3b-a32e-9f30c3c70a81,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:30.665729 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54094) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:30.733742 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.736274 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 51f77003-54ff-44ef-a4c0-98da6c460703 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:49:30.763289 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.831638 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a77d82be-97ca-4ba7-a401-3af823d860d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.839938 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.842609 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:30.843820 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e8885f86-6a96-4f3b-a32e-9f30c3c70a81 HTTP/1.1" status: 204 len: 168 time: 0.1777334 Nov 15 17:49:30.857337 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175c0dcf-4bb8-4c7c-bb4b-fce534d76b36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8885f86-6a96-4f3b-a32e-9f30c3c70a81,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:30.898376 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=51f77003-54ff-44ef-a4c0-98da6c460703,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:30.917545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '51f77003-54ff-44ef-a4c0-98da6c460703', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'port_id': '51f77003-54ff-44ef-a4c0-98da6c460703', 'mac_address': 'fa:16:3e:b8:b7:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 431, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6a2eeae-0fac-4586-be17-093ae2e28ec5', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:49:31.017574 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc07d64-7cdc-4b62-96e5-ed809a8f40e3 req-241b8239-c4ca-48f8-881a-22618c9289a8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:31.019303 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5dc07d64-7cdc-4b62-96e5-ed809a8f40e3 req-241b8239-c4ca-48f8-881a-22618c9289a8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 944 time: 0.0661607 Nov 15 17:49:31.083273 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5dc07d64-7cdc-4b62-96e5-ed809a8f40e3 req-9cfe0807-e0bc-4eb8-b016-577b0c07a9f3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571187 Nov 15 17:49:31.130100 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:31.145225 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 51f77003-54ff-44ef-a4c0-98da6c460703 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:31.165440 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=51f77003-54ff-44ef-a4c0-98da6c460703,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:31.171336 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:31.221127 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:31.228136 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.228519 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.228851 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.229268 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.229606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.229923 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.230243 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.230561 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.230896 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.231212 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.231508 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.231846 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:31.390990 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf9a5a1-3729-4077-88d9-f5c0cd7b3813 req-a2a6ab8f-5b11-449f-ac2d-0be70528f845 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:31.392757 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3bf9a5a1-3729-4077-88d9-f5c0cd7b3813 req-a2a6ab8f-5b11-449f-ac2d-0be70528f845 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0623369 Nov 15 17:49:31.461218 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d1fe13f-135a-4fd9-b255-5f82dab49758 req-2c93d216-e654-4b5a-bf2a-cd39caf04f66 tempest-DeleteServersTestJSON-1209110884 tempest-DeleteServersTestJSON-1209110884-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad299796-87ba-48d7-a2b2-8bb03351fd76 HTTP/1.1" status: 200 len: 210 time: 0.0317011 Nov 15 17:49:31.488397 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3bf9a5a1-3729-4077-88d9-f5c0cd7b3813 req-346ebb6d-0fba-4d91-a520-0f9cbbd3245d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847034 Nov 15 17:49:31.492998 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['51f77003-54ff-44ef-a4c0-98da6c460703'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:32.201509 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd50326-ac6d-404a-9c7d-3610c4b75c45 req-d0f971c3-634e-4f2e-b5f0-c9281bd41d08 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:32.203114 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4cd50326-ac6d-404a-9c7d-3610c4b75c45 req-d0f971c3-634e-4f2e-b5f0-c9281bd41d08 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 945 time: 0.0508971 Nov 15 17:49:32.256297 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4cd50326-ac6d-404a-9c7d-3610c4b75c45 req-fc82d3c8-01a0-4846-9a47-7e5569b5ca6f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467334 Nov 15 17:49:32.640194 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c87dd9-a304-4a3e-b9a2-47475d7dc244 req-d9215450-8a8e-485b-9be5-da4198591f05 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:32.644226 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-50c87dd9-a304-4a3e-b9a2-47475d7dc244 req-d9215450-8a8e-485b-9be5-da4198591f05 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0606172 Nov 15 17:49:32.710827 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-50c87dd9-a304-4a3e-b9a2-47475d7dc244 req-a988727a-39ea-4af4-9a85-2668e5a8093f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615861 Nov 15 17:49:32.745535 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 51f77003-54ff-44ef-a4c0-98da6c460703 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:32.801379 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 51f77003-54ff-44ef-a4c0-98da6c460703 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:49:32.807345 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 51f77003-54ff-44ef-a4c0-98da6c460703 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:32.807545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:32.890258 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:32.913598 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:32.916258 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4314b93-b480-4f90-a421-4231c67d8dc4" -d '{"events": [{"server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "name": "network-vif-plugged", "status": "completed", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:32.929514 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=51f77003-54ff-44ef-a4c0-98da6c460703,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:32.935783 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:32.936843 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:49:32.979142 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-098af119-32b5-4aac-adfa-8fc7feb039a0 x-openstack-request-id: req-098af119-32b5-4aac-adfa-8fc7feb039a0 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:32.979446 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "name": "network-vif-plugged", "status": "completed", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:32.979918 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-098af119-32b5-4aac-adfa-8fc7feb039a0 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:32.980481 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703', 'code': 200} Nov 15 17:49:32.983388 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:49:32.984370 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 998a7bad-c8ca-4278-93c2-bc9e99bb6c98 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:49:33.015544 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:33.084468 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b99e75d7-c416-45dd-a551-bb81f5b2fe2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:33.207403 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3980a1f-74aa-4ed4-b490-0560802d1f48 req-da45b8e0-5a83-42bb-b854-9a4051ffc9c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:33.209205 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f3980a1f-74aa-4ed4-b490-0560802d1f48 req-da45b8e0-5a83-42bb-b854-9a4051ffc9c4 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 1099 time: 0.0573320 Nov 15 17:49:33.255006 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f3980a1f-74aa-4ed4-b490-0560802d1f48 req-14baf89b-71ea-4225-8a80-0b5784fb2bd5 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382354 Nov 15 17:49:33.378222 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff8129b-6d7e-44ea-ae6f-5b8f04e83a13 req-a9644315-27a9-4605-ada8-22a6a387c9fc tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:33.379731 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cff8129b-6d7e-44ea-ae6f-5b8f04e83a13 req-a9644315-27a9-4605-ada8-22a6a387c9fc tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0508962 Nov 15 17:49:33.428370 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cff8129b-6d7e-44ea-ae6f-5b8f04e83a13 req-bb7d57e8-5702-4de4-a4bc-f2586ff740cb tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423641 Nov 15 17:49:33.835312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad107e4-ba27-4d65-a9bd-356cdaacf329 req-6c40abde-486e-4fd4-894d-538bfb19c869 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:33.836806 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ad107e4-ba27-4d65-a9bd-356cdaacf329 req-6c40abde-486e-4fd4-894d-538bfb19c869 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0491159 Nov 15 17:49:33.890897 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ad107e4-ba27-4d65-a9bd-356cdaacf329 req-b0c9c869-e77e-480d-881a-69d059027034 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477386 Nov 15 17:49:33.967036 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54238) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:34.014200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Deleting subnet 28e89ccf-c78a-4f2e-be95-0646f1dfc889 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:49:34.017523 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.054777 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.094300 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.145966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.174560 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=28e89ccf-c78a-4f2e-be95-0646f1dfc889,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:34.178436 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.181917 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ee0c87bc-b1c4-4353-a7f7-4434bc913afc admin admin] 10.222.0.31 "DELETE /v2.0/subnets/28e89ccf-c78a-4f2e-be95-0646f1dfc889 HTTP/1.1" status: 204 len: 168 time: 0.2136607 Nov 15 17:49:34.184520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54240) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:34.256902 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.338847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.359376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.359736 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.360478 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.360815 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > port after_create 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.361151 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > port after_delete 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.361463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > port after_update 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.361807 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.362125 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.362440 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.362755 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.435455 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.436161 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.436161 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.436436 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 17:49:34.436855 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c6711a21-f84e-4a09-b311-4dc71011fb84']}} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:34.448947 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.455249 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16') {'for_net_delete': True} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:34.455650 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c9c85cd9-2596-49ad-ac18-9a7fdef83b16') {} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:34.472545 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59181159'] for segment, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.493846 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.511837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Releasing vlan 436 on physical network physnet1 to pool {{(pid=108141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:49:34.512201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59170109'] for segment, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: from cryptography.utils import int_from_bytes Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: from cryptography.utils import int_from_bytes Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: Traceback (most recent call last): Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: timer() Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: cb(*args, **kw) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: return func(*args, **kwargs) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: self._notify() Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: self.callback(batched_events) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: event.method(event) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: return f(self, *a, **k) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._get(url).json() Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: return self.request(url, 'GET', **kwargs) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:49:34.516255 dv-cinder-788366-7-iscsi neutron-server[108141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:49:34.590531 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.600180 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99bd7be-3125-4b5b-8518-56fc469fec34 req-9d6287f0-9292-488e-b653-206c1ef2ec80 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:34.601717 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b99bd7be-3125-4b5b-8518-56fc469fec34 req-9d6287f0-9292-488e-b653-206c1ef2ec80 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.1017725 Nov 15 17:49:34.606777 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.609861 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] 10.222.0.31 "DELETE /v2.0/networks/c6711a21-f84e-4a09-b311-4dc71011fb84 HTTP/1.1" status: 204 len: 168 time: 0.4242873 Nov 15 17:49:34.626385 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dd8f975-862d-45c1-b6d3-7c2b325b914c admin admin] Pushing event deleted for resources: {'Network': ['ID=c6711a21-f84e-4a09-b311-4dc71011fb84,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:34.679988 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b99bd7be-3125-4b5b-8518-56fc469fec34 req-97c5c57d-f619-4a1d-827f-285e4205df75 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663662 Nov 15 17:49:34.785753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54252) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:34.824347 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f03f8074-56d1-4e54-b77b-b673af5bd2ff admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=04f55f51f2b5414d837b134a5c85985c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0374758 Nov 15 17:49:34.826854 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54254) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:34.874335 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.894572 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.942862 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.946622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:34.948056 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/52d54288-df95-4dd1-966e-7c26bef58326 HTTP/1.1" status: 204 len: 168 time: 0.1203315 Nov 15 17:49:34.956462 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-292401db-4f44-41f3-a79f-134f4b2443a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52d54288-df95-4dd1-966e-7c26bef58326,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:35.023628 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a6a7ff-7642-4a38-b38a-939c356a8c07 req-fbc9950e-c651-420b-a63e-068a919357ab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:35.025283 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a6a6a7ff-7642-4a38-b38a-939c356a8c07 req-fbc9950e-c651-420b-a63e-068a919357ab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0587108 Nov 15 17:49:35.076138 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a6a6a7ff-7642-4a38-b38a-939c356a8c07 req-c255b027-78e1-4215-bfd7-041a469d6667 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450640 Nov 15 17:49:35.552660 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:35.789088 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a432d0-b06b-42a5-a836-e4cc71148bd2 req-bd6d4748-2264-4ec4-8349-48866d8463a8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:35.790573 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e0a432d0-b06b-42a5-a836-e4cc71148bd2 req-bd6d4748-2264-4ec4-8349-48866d8463a8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0483797 Nov 15 17:49:35.815616 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54286) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:35.838470 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e0a432d0-b06b-42a5-a836-e4cc71148bd2 req-5cd5ecd1-bb01-4aac-a1cb-0af5c25047fa tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413821 Nov 15 17:49:35.913050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-network', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:35.937982 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Made reservation on behalf of 8d7c8a074d704613bf45e1c8d95834e9 for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:35.941813 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:35.956056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.037252 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.042782 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.066200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] vlan segment allocate from pool success with {'vlan_id': 447, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:49:36.079605 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f847ccb-7395-4d8e-9932-0fe0c352ee71,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:36.084223 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.084587 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Added segment 27f12457-b2da-466e-9e22-d4c08a5b79c1 of type vlan for network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 Nov 15 17:49:36.124894 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.151898 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.152881 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:36.153514 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.195827 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e709a72-2288-4041-be96-277b52eeae0d req-62c32596-a049-4ba5-8a85-ab7c588a757a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:36.197482 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e709a72-2288-4041-be96-277b52eeae0d req-62c32596-a049-4ba5-8a85-ab7c588a757a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0499613 Nov 15 17:49:36.212334 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.3954146 Nov 15 17:49:36.215145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54292) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:36.222376 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Request body: {'subnet': {'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-subnet', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:36.228168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637ab129-8e82-4f06-8507-a1f4f8f6b486 admin admin] Pushing event updated for resources: {'Network': ['ID=927b3da0-f3f2-41e8-b00d-4ab5e71093d8,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:36.239198 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:49:36.248444 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e709a72-2288-4041-be96-277b52eeae0d req-9e310d87-c944-45fb-8a2d-cf8b18ad756d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446119 Nov 15 17:49:36.250032 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Made reservation on behalf of 8d7c8a074d704613bf45e1c8d95834e9 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:36.252586 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.434763 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.495761 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=82578c0d-639e-4df9-bec7-8ae336a8ba92,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:36.505110 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Checking segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:36.505531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Network hostable DHCP agents. Network: 927b3da0-f3f2-41e8-b00d-4ab5e71093d8, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:49:36.526547 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:49:36.535776 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 927b3da0-f3f2-41e8-b00d-4ab5e71093d8) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:36.542909 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:36.543606 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.544129 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a7de63d-39c8-4b66-9999-0c19b11566b9 None None] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:36.560752 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-d7f02bee-8bc1-47a3-bd5b-2e167d62d3cf admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3443179 Nov 15 17:49:36.563519 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54298) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:36.568208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:36.589882 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.591080 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.643116 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.679808 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.718174 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:49:36.719101 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.788403 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:36.856133 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Allocated IP 172.20.0.2 (927b3da0-f3f2-41e8-b00d-4ab5e71093d8/82578c0d-639e-4df9-bec7-8ae336a8ba92/9d9f1b93-fcbf-4976-ab96-eb5423e0d700) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:36.980310 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db44996-9a0b-4a52-ac9a-a459a1649640 req-64d3aca5-8598-4f20-9505-461e2b646af7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:36.988302 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7db44996-9a0b-4a52-ac9a-a459a1649640 req-64d3aca5-8598-4f20-9505-461e2b646af7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0703380 Nov 15 17:49:37.021837 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.026201 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.033501 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.045144 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.055417 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7db44996-9a0b-4a52-ac9a-a459a1649640 req-ade61e99-3ca0-4971-9ab8-0bf7c1ef85c7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621860 Nov 15 17:49:37.079177 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:37.082243 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:37.086452 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:37.090925 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Pushing event updated for resources: {'Port': ['ID=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:37.141093 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Attempting to bind port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:37.141460 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Attempting to bind port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:37.141847 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Attempting to bind port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:37.147206 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:37.147562 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Checking segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:37.148100 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.148424 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Bound using segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:37.148884 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Bound port: 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:37.149291 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.153353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Allocated IP 172.27.0.224 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/c7c19085-c04e-438d-8d0f-77bd0df3a2d5) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:37.210682 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] For port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:37.214538 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] For port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:37.218828 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.270043 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.294857 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67cf28be-f37d-4b36-a295-26afac93be89 None None] Pushing event updated for resources: {'Port': ['ID=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:37.320072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:37.348731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:37.375647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:37.381626 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:37.461394 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Pushing event updated for resources: {'Port': ['ID=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:37.475260 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c517a6c-81d8-4191-9844-17b6b4ea5554 req-acecd81c-a547-4241-9f01-a2ca0385405a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:37.484344 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7c517a6c-81d8-4191-9844-17b6b4ea5554 req-acecd81c-a547-4241-9f01-a2ca0385405a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1152849 Nov 15 17:49:37.551973 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7c517a6c-81d8-4191-9844-17b6b4ea5554 req-c240a76f-a5b4-46b1-a2d2-b6636731825b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653198 Nov 15 17:49:37.817534 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:38.023909 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:38.188666 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Router 74405065-b5c8-4585-a4db-196d01c514b1 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:49:38.215851 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f8fc1a-45eb-4149-a645-f54b39d8f99a req-f479bd23-e8ee-46c1-933d-819afe2a2b73 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:38.224307 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-05f8fc1a-45eb-4149-a645-f54b39d8f99a req-f479bd23-e8ee-46c1-933d-819afe2a2b73 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0795243 Nov 15 17:49:38.323056 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-05f8fc1a-45eb-4149-a645-f54b39d8f99a req-aa9cd840-92c4-467a-9b38-1c3b89bcff63 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886741 Nov 15 17:49:38.335517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:49:38.346821 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:49:38.360808 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:38.365365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54364) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:38.366432 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:38.368737 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:38.374163 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-e185971a-fae7-44b1-be02-1e3ba06daa08 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 1.8094103 Nov 15 17:49:38.559150 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:38.643296 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d1972b1-d0eb-4e7b-83dc-66956c396bd6 None None] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:49:38.769119 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] Provisioning complete for port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:38.769487 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:38.899101 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:37Z', 'revision_number': 3, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:38.953070 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:49:38.953627 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Updating router 74405065-b5c8-4585-a4db-196d01c514b1 port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:49:38.970310 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:38.989391 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.024819 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] For port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:39.034597 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.118434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea28689-263f-4ffb-bf75-84e7dcbf159c None None] Pushing event updated for resources: {'Port': ['ID=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:39.149732 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6899f4-e3cb-42ae-8826-f3ad097a14ff req-52d8ce28-61d5-4c76-9436-b04c5d5ec6fc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:39.151827 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5f6899f4-e3cb-42ae-8826-f3ad097a14ff req-52d8ce28-61d5-4c76-9436-b04c5d5ec6fc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1675718 Nov 15 17:49:39.240212 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5f6899f4-e3cb-42ae-8826-f3ad097a14ff req-066adce8-0f04-4738-8ea8-f3e86352c2c4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756655 Nov 15 17:49:39.361949 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-1fc06f61-cce6-445a-a285-4520a9c7fba4 None None] Provisioning complete for port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:39.362306 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1fc06f61-cce6-445a-a285-4520a9c7fba4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.392642 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.402745 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.414972 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:39.454938 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Attempting to bind port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:39.455326 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Attempting to bind port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:39.455673 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Attempting to bind port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:39.466231 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:39.466611 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:39.467014 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.467592 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:39.468267 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Bound port: c7c19085-c04e-438d-8d0f-77bd0df3a2d5, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:39.468665 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.470719 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Pushing event updated for resources: {'Port': ['ID=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,revision_number=2']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:39.504658 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.505301 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.505793 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.506268 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.506844 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.507307 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.508043 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.508537 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.508974 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:39.509406 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.509520 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.510044 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.510503 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.510959 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:49:39.581455 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] For port c7c19085-c04e-438d-8d0f-77bd0df3a2d5, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:39.585201 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] For port c7c19085-c04e-438d-8d0f-77bd0df3a2d5, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:39.592577 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.660763 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7131f92e-295b-4f1a-aefa-d36c3e2526e9 None None] Pushing event updated for resources: {'Port': ['ID=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:39.665948 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:39.666622 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:39.775310 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:39.799977 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:39.967978 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Allocated IP 172.20.0.1 (927b3da0-f3f2-41e8-b00d-4ab5e71093d8/82578c0d-639e-4df9-bec7-8ae336a8ba92/a8112831-21d6-4674-bd6b-bbb20d57e836) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:39.997977 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:37Z', 'revision_number': 3, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:40.032030 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d868618a-9892-43a0-bf4c-b59032048ed3 None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:37Z', 'revision_number': 3, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:49:40.102039 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:40.149356 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:40.188592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:40.188592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:40.192464 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:40.238721 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Pushing event updated for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:40.262694 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:40.549964 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-28c47bba-565e-44e3-8635-8a34de1827d9 None None] Provisioning complete for port a8112831-21d6-4674-bd6b-bbb20d57e836 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:40.550924 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-28c47bba-565e-44e3-8635-8a34de1827d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:40.625337 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-28c47bba-565e-44e3-8635-8a34de1827d9 None None] Port a8112831-21d6-4674-bd6b-bbb20d57e836 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:49:40.633896 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d8fd02-7d80-4618-89b1-883272bae65e req-f3a7f5e5-c7c1-4b6e-abd7-7e3e48ead992 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:40.640546 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8d8fd02-7d80-4618-89b1-883272bae65e req-f3a7f5e5-c7c1-4b6e-abd7-7e3e48ead992 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.2137070 Nov 15 17:49:40.696321 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:40.735155 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8d8fd02-7d80-4618-89b1-883272bae65e req-16bbbb1f-1721-42f6-8c26-d253bb0fc29b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847516 Nov 15 17:49:41.000774 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-c7253ba9-1a5e-4cb4-afcb-a504ca3fd8bd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:41.002256 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-c7253ba9-1a5e-4cb4-afcb-a504ca3fd8bd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.1509149 Nov 15 17:49:41.030420 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-5a868295-68b4-41eb-bfb7-72077e57bfca tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/quotas/cdb494aa542c4eff8e62f9dd653bde82 HTTP/1.1" status: 200 len: 375 time: 0.0214086 Nov 15 17:49:41.032852 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.047593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.148217 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Pushing event updated for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:41.151345 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.172588 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-2859befc-741f-474a-8a38-5a464f712c87 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1355214 Nov 15 17:49:41.218859 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54494) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:41.332317 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:41.341727 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-5fa4ea3c-4c5c-4dff-ab5f-c6d9ebbf4732 service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1589372 Nov 15 17:49:41.350340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:41.478283 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device c7c19085-c04e-438d-8d0f-77bd0df3a2d5 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:41.560467 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-9f70d55a-ba6b-4cff-b166-a316676de868 service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2177439 Nov 15 17:49:41.594469 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:41.595000 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.618802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:49:41.669966 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-fe51fe7c-81ba-4c5a-9a1b-5289d39a05bb None None] Provisioning complete for port a8112831-21d6-4674-bd6b-bbb20d57e836 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:41.670570 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fe51fe7c-81ba-4c5a-9a1b-5289d39a05bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.819770 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-fe51fe7c-81ba-4c5a-9a1b-5289d39a05bb None None] Port a8112831-21d6-4674-bd6b-bbb20d57e836 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:49:41.842409 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:41.888341 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54540) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:41.890755 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:49:41.908036 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3d2d5c6d-d165-4b58-993a-1e8c0e92c771 admin admin] 10.222.0.31 "PUT /v2.0/routers/74405065-b5c8-4585-a4db-196d01c514b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5414181 Nov 15 17:49:41.913004 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port c7c19085-c04e-438d-8d0f-77bd0df3a2d5, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:41.919418 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.028580 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:42.107635 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Deleting subnet 200df6ca-bf0e-4c64-866c-ceb13bac4785 {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:49:42.109216 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-25ba1cfe-78a1-4703-af1a-d1c140e74fb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.111454 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.151688 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-92f3f3ea-f6fe-4028-bdda-5825a1f1f727 req-26c1b8ec-f216-481b-886b-f883b72709ea tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 210 time: 0.0496874 Nov 15 17:49:42.175219 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8370cf0-1ef7-4aad-b2bf-8ba846556696 req-e3297403-4fea-4791-920b-c5916dde3b60 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:42.176799 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8370cf0-1ef7-4aad-b2bf-8ba846556696 req-e3297403-4fea-4791-920b-c5916dde3b60 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.2875338 Nov 15 17:49:42.230370 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-25ba1cfe-78a1-4703-af1a-d1c140e74fb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.237461 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.237870 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-25ba1cfe-78a1-4703-af1a-d1c140e74fb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.278035 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ba1cfe-78a1-4703-af1a-d1c140e74fb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fb63464-8fb0-4af6-a75c-cfed9feed106,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:42.297846 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8370cf0-1ef7-4aad-b2bf-8ba846556696 req-cb530e22-5852-4baa-9c32-a7e76c20e5d6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967774 Nov 15 17:49:42.309550 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-25ba1cfe-78a1-4703-af1a-d1c140e74fb6 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e29e9f94e18b4812accf7e8d95ee599c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0894525 Nov 15 17:49:42.309826 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54554) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:42.320252 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.342725 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:49:42.356328 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:42.356971 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:42.414610 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.458376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.467731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.490879 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:42.509594 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=200df6ca-bf0e-4c64-866c-ceb13bac4785,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:42.517822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.524305 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54558) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:42.533426 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-fe65a701-c4ec-417c-9662-3ab7f724fa76 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/200df6ca-bf0e-4c64-866c-ceb13bac4785 HTTP/1.1" status: 204 len: 168 time: 0.6243451 Nov 15 17:49:42.572043 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54560) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:42.578891 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1745953017', 'description': 'tempest-description--1046662176'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:42.592381 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.594833 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.598735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/3fb63464-8fb0-4af6-a75c-cfed9feed106 HTTP/1.1" status: 204 len: 168 time: 0.2832279 Nov 15 17:49:42.613552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb135dd-f581-40c5-bc19-b988f3eccc47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fb63464-8fb0-4af6-a75c-cfed9feed106,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:42.623010 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.646665 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.724507 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.731685 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.781505 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.786075 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.2108631 Nov 15 17:49:42.786946 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54566) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:42.791437 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.792955 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group_rule': {'security_group_id': '80e4d0ba-b6e2-415e-9ff2-8b59489ede80', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:42.814267 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb52df8-1ee5-4a95-8fad-73f6b33b1a1d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=80e4d0ba-b6e2-415e-9ff2-8b59489ede80,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:42.815081 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f819556-4c31-4add-a5a8-03cdf64edfa2']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:42.828725 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e56b7ebc-26de-4041-8846-3a17739fefb7') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:42.829168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e56b7ebc-26de-4041-8846-3a17739fefb7') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:42.842048 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.847781 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.872019 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.873027 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 2, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:42.879416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Releasing vlan 429 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:49:42.880004 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:49:42.945949 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:49:42.961280 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.994562 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:42.998978 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.014657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Pushing event deleted for resources: {'Network': ['ID=8f819556-4c31-4add-a5a8-03cdf64edfa2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.019413 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.028746 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f6fcc566-8fe4-4b3c-a3ea-a0dc67b2d424 admin admin] 10.222.0.31 "DELETE /v2.0/networks/8f819556-4c31-4add-a5a8-03cdf64edfa2 HTTP/1.1" status: 204 len: 168 time: 0.5029569 Nov 15 17:49:43.030239 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54576) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.043412 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ecf058a-d644-4ec0-9d34-246e0a6cf689,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.050788 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.052393 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-40376c10-73a0-4728-b869-80dc95b51a4e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2634003 Nov 15 17:49:43.055243 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54580) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.060671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group_rule': {'security_group_id': '80e4d0ba-b6e2-415e-9ff2-8b59489ede80', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:43.094380 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8f39e1-6a12-445b-aa1b-9608323de2b0 req-abb73ac4-70b7-42fd-8ef6-ee689ceeb663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:43.096066 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e8f39e1-6a12-445b-aa1b-9608323de2b0 req-abb73ac4-70b7-42fd-8ef6-ee689ceeb663 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 1098 time: 0.1478801 Nov 15 17:49:43.099542 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Deleting subnet dbb3fa0e-8892-4a52-bfe0-fb11e9bd0e6e {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:49:43.104055 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.106984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.140753 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:49:43.141576 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Updating router 74405065-b5c8-4585-a4db-196d01c514b1 port a8112831-21d6-4674-bd6b-bbb20d57e836 binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:49:43.149340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54582) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.151348 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.175483 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.178931 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f299551a-cce7-4e4c-8d3b-51834f62473b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.255573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.283767 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d023a307-1ca9-4377-9b0d-51a80f0332aa req-624181ca-2c0a-40a6-8eee-8bdc7607e9a6 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 210 time: 0.0356617 Nov 15 17:49:43.300268 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.318755 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.349798 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=87741fcf-d874-43d6-85f5-f9c4f59111b7,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.368158 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.372700 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f2bb2103-d6df-4c2a-9576-85494f9435a4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3136065 Nov 15 17:49:43.373316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54590) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.377713 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:43.383244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f299551a-cce7-4e4c-8d3b-51834f62473b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.385902 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54592) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.404270 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f299551a-cce7-4e4c-8d3b-51834f62473b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.448620 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e8f39e1-6a12-445b-aa1b-9608323de2b0 req-b385bc68-dca9-4e22-b369-794ce11de8cc service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2603099 Nov 15 17:49:43.452463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.462121 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f299551a-cce7-4e4c-8d3b-51834f62473b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=730df19ebc46410998987f47b30c23c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3082376 Nov 15 17:49:43.466898 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54596) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.472198 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f299551a-cce7-4e4c-8d3b-51834f62473b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e062b438-fdd9-481d-8aeb-06aa8cc2550f,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.476718 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device c7c19085-c04e-438d-8d0f-77bd0df3a2d5 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:43.497322 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.540727 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.546931 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] 10.222.0.31 "DELETE /v2.0/subnets/dbb3fa0e-8892-4a52-bfe0-fb11e9bd0e6e HTTP/1.1" status: 204 len: 168 time: 0.5126977 Nov 15 17:49:43.551895 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54598) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:43.566783 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2412e3f-81b5-4deb-8ca4-3f70d1bd5a81 req-8976ab8d-f82b-448d-b12f-a24ad611b71f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:43.568518 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2412e3f-81b5-4deb-8ca4-3f70d1bd5a81 req-8976ab8d-f82b-448d-b12f-a24ad611b71f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0925932 Nov 15 17:49:43.591737 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:43.592209 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.594848 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-53437b4d-b40a-45c8-a02e-64e409e3c051 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.595322 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d7988d-9903-4ff0-af8c-86f378d3f18c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dbb3fa0e-8892-4a52-bfe0-fb11e9bd0e6e,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.647463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.678662 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.689016 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.776620 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.782623 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2806ee5-b786-468d-86ed-05128e988af1 None None] Pushing event updated for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:43.805823 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.851908 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Attempting to bind port a8112831-21d6-4674-bd6b-bbb20d57e836 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:43.852671 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Attempting to bind port a8112831-21d6-4674-bd6b-bbb20d57e836 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:43.853582 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Attempting to bind port a8112831-21d6-4674-bd6b-bbb20d57e836 on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:43.862294 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:43.863182 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Checking segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:43.863886 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.864484 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Bound using segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:43.865183 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Bound port: a8112831-21d6-4674-bd6b-bbb20d57e836, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:43.865779 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.882301 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2412e3f-81b5-4deb-8ca4-3f70d1bd5a81 req-fbc45d52-7a70-4e12-bb3e-7b7f66350da2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3035493 Nov 15 17:49:43.943573 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.984797 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] For port a8112831-21d6-4674-bd6b-bbb20d57e836, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:43.986729 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-53437b4d-b40a-45c8-a02e-64e409e3c051 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:43.988614 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] For port a8112831-21d6-4674-bd6b-bbb20d57e836, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a8112831-21d6-4674-bd6b-bbb20d57e836,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:43.997328 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.006904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-92c0cd85-5bfa-4995-b85f-a7a84225d0a7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:44.008463 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-92c0cd85-5bfa-4995-b85f-a7a84225d0a7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.3058531 Nov 15 17:49:44.009406 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.011868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.015375 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e062b438-fdd9-481d-8aeb-06aa8cc2550f HTTP/1.1" status: 204 len: 168 time: 0.5444355 Nov 15 17:49:44.032276 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-53437b4d-b40a-45c8-a02e-64e409e3c051 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.045945 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Request body: {'port': {'device_id': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'admin_state_up': True, 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:44.058811 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.089810 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2806ee5-b786-468d-86ed-05128e988af1 None None] Pushing event updated for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.107505 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:49:44.108434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:44.120636 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-53437b4d-b40a-45c8-a02e-64e409e3c051 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=5bdcb0b89b7b482aacb133e337793bd8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7335641 Nov 15 17:49:44.124067 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54606) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:44.126014 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53437b4d-b40a-45c8-a02e-64e409e3c051 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55d8c634-b5e1-4dde-b050-bc1f35f73693,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.149913 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a619d86f-abb3-4c10-8311-c84ae5607b0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e062b438-fdd9-481d-8aeb-06aa8cc2550f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.205063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Allocated IP 172.27.0.110 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/72c30e68-37dc-49d9-b09b-ca6116af869b) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:44.207946 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29e676da-b0e2-4ebb-89c5-cff94d58f703']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:44.238862 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.240409 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa3ebc57-cb0e-47fd-ab57-1cdcb6fb57c5') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:44.240701 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa3ebc57-cb0e-47fd-ab57-1cdcb6fb57c5') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:44.274493 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.285638 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] Provisioning complete for port a8112831-21d6-4674-bd6b-bbb20d57e836 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:44.295135 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.308031 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.353855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.365817 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:49:44.372598 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Releasing vlan 425 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:49:44.374960 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:49:44.408900 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:49:44.469359 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.471908 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.473058 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/55d8c634-b5e1-4dde-b050-bc1f35f73693 HTTP/1.1" status: 204 len: 168 time: 0.3479576 Nov 15 17:49:44.476862 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.481447 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-216dee3b-1d23-4fc6-b630-cca8344d84f6 req-0690aa0d-31d1-4ed8-a710-e9e40286aaa9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 210 time: 0.0713253 Nov 15 17:49:44.491977 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eca8f799-b2d2-419d-91de-7a1cda0fd543 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55d8c634-b5e1-4dde-b050-bc1f35f73693,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.521136 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.535416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.539344 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] 10.222.0.31 "DELETE /v2.0/networks/29e676da-b0e2-4ebb-89c5-cff94d58f703 HTTP/1.1" status: 204 len: 168 time: 0.9539180 Nov 15 17:49:44.566931 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.572543 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c44fc7-750a-4c5f-81e6-de3c2fde2577 admin admin] Pushing event deleted for resources: {'Network': ['ID=29e676da-b0e2-4ebb-89c5-cff94d58f703,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.597629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:44.605852 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.608270 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.614562 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:44.622230 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:44.625545 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:44.658203 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=72c30e68-37dc-49d9-b09b-ca6116af869b,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.670373 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] For port a8112831-21d6-4674-bd6b-bbb20d57e836, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a8112831-21d6-4674-bd6b-bbb20d57e836,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:44.682612 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.755306 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.768032 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfaa9803-8279-44e7-93d3-c14acf8966f2 None None] Pushing event updated for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:44.780397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:43Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:49:44.812281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.816377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c48816fa-0940-41ca-a138-acd14639d9f8 None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:43Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:49:44.836441 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-80f3ace5-67e5-413e-a4d4-61a9bd00fe98 None None] Provisioning complete for port a8112831-21d6-4674-bd6b-bbb20d57e836 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:44.836813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-80f3ace5-67e5-413e-a4d4-61a9bd00fe98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:44.917749 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54626) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:45.007506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Allocated IP 172.20.0.11 (3919dfc4-3e42-4144-97e7-2ccb5146f2a2/c6a2eeae-0fac-4586-be17-093ae2e28ec5/6ccdae31-65e3-4a19-b710-4eca9f518175) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:45.071149 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-04be81dc-a3bd-434b-b693-5032939ce6bf admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=1cfb619502ff4caf9d8eac915d65cf45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1522608 Nov 15 17:49:45.075160 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54630) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:45.200104 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09ad265-1f13-4b26-8cf3-17f8cd2504b5 req-614788e8-1d19-4e71-90a3-50133f3cb8ff tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:45.208586 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f09ad265-1f13-4b26-8cf3-17f8cd2504b5 req-614788e8-1d19-4e71-90a3-50133f3cb8ff tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1825268 Nov 15 17:49:45.210130 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54634) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:45.250568 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6a45a98b-b57b-4378-801b-a5fee399cc38 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.291080 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.316236 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f09ad265-1f13-4b26-8cf3-17f8cd2504b5 req-86fbc6e3-6d61-41e9-bb96-5132c8c0e7ed tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677235 Nov 15 17:49:45.347014 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.358591 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.366568 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.391433 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.498999 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a8112831-21d6-4674-bd6b-bbb20d57e836 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:45.501148 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=72c30e68-37dc-49d9-b09b-ca6116af869b,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:45.502774 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.511675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.548903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.551892 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-74f7c9ed-cefe-4b50-9c99-351381f4c33c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.1775768 Nov 15 17:49:45.552868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6a45a98b-b57b-4378-801b-a5fee399cc38 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.563516 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6a45a98b-b57b-4378-801b-a5fee399cc38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.566413 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.575055 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.581699 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/b96be19f-c793-448f-a182-0a226920ef47 HTTP/1.1" status: 204 len: 168 time: 0.5054336 Nov 15 17:49:45.595133 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237', '51f77003-54ff-44ef-a4c0-98da6c460703'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:45.621017 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:45.630883 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:45.641573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:45.644107 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event updated for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:45.682881 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-6a45a98b-b57b-4378-801b-a5fee399cc38 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c66628de65f34349b77553e74d30f559&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4694874 Nov 15 17:49:45.689632 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54650) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:45.701103 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a45a98b-b57b-4378-801b-a5fee399cc38 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a57263a-47f3-4824-871c-7df07362ce02,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:45.781951 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:45.783638 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.785037 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffddb040-1fa8-4c1c-b14e-5b3184dae4e5 req-8787f2d3-acb1-4490-ba97-5441568f2600 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:45.809074 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ffddb040-1fa8-4c1c-b14e-5b3184dae4e5 req-8787f2d3-acb1-4490-ba97-5441568f2600 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 932 time: 0.1432347 Nov 15 17:49:45.812310 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d672fb4d-91f1-490f-ba0b-bcd8d175880f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b96be19f-c793-448f-a182-0a226920ef47,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:45.816719 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.828559 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port a8112831-21d6-4674-bd6b-bbb20d57e836 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:45.829747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.844070 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-41377723-4a50-4638-b9ea-811ea6a57285 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8164775 Nov 15 17:49:45.857457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:45.866510 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Request body: {'port': {'device_id': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:45.955990 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ffddb040-1fa8-4c1c-b14e-5b3184dae4e5 req-e2fb7b36-568c-402c-a4b4-06807961154d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1392891 Nov 15 17:49:45.967505 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.035623 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-ea86e117-c875-487d-9dc1-d97dd6652d1b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1745953017&fields=id&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 267 time: 0.1000202 Nov 15 17:49:46.133145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.135921 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.137070 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/2a57263a-47f3-4824-871c-7df07362ce02 HTTP/1.1" status: 204 len: 168 time: 0.4464927 Nov 15 17:49:46.150096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39ab650f-ba07-4b4a-9ec0-dbf260efff13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a57263a-47f3-4824-871c-7df07362ce02,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:46.322292 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-1053d08b-db22-4003-933b-8ae8fee89344 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:46.328810 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-1053d08b-db22-4003-933b-8ae8fee89344 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 817 time: 0.2791526 Nov 15 17:49:46.358951 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-851f1702-dde9-4e25-b627-0e738959db0f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/quotas/8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 375 time: 0.0240653 Nov 15 17:49:46.363500 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54672) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:46.442615 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6ccdae31-65e3-4a19-b710-4eca9f518175 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:46.452956 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.472630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Transition to ACTIVE for port object 6ccdae31-65e3-4a19-b710-4eca9f518175 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:49:46.486860 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.511488 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-9836e46b-eae8-4a8b-8624-01fc87f0c98f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1444714 Nov 15 17:49:46.518867 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-17b02ce1-70e9-4307-bc2e-17cb377c8f55 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=59287bc5adcb4409b0c01786d302440a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1503403 Nov 15 17:49:46.523411 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54676) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:46.542207 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b091a5-9d78-4e16-a098-3794d1ee5787 req-7d9649bc-6fd6-4f11-8a8c-08c39123a993 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:46.543750 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-99b091a5-9d78-4e16-a098-3794d1ee5787 req-7d9649bc-6fd6-4f11-8a8c-08c39123a993 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.1281991 Nov 15 17:49:46.663981 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-99b091a5-9d78-4e16-a098-3794d1ee5787 req-1d225406-f1a0-4785-812e-24b6425004ed tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112745 Nov 15 17:49:46.678436 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.682872 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-53297394-2ccf-4e94-a540-1660cfd0d946 service neutron] 10.222.0.31 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1491261 Nov 15 17:49:46.702914 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Pushing event updated for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:46.734406 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54684) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:46.773885 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.783316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c9b34a44-8313-47bf-ad5f-5606f820de81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.823282 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Attempting to bind port 6ccdae31-65e3-4a19-b710-4eca9f518175 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:46.823626 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Attempting to bind port 6ccdae31-65e3-4a19-b710-4eca9f518175 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:46.824003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Attempting to bind port 6ccdae31-65e3-4a19-b710-4eca9f518175 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:46.834891 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Port 6ccdae31-65e3-4a19-b710-4eca9f518175 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:49:46.835256 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Attempting to bind port 6ccdae31-65e3-4a19-b710-4eca9f518175 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:46.841190 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:46.841532 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Checking segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:46.841916 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Bound using segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:46.842461 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Bound port: 6ccdae31-65e3-4a19-b710-4eca9f518175, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:46.842821 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.872318 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-725764aa-679c-4d4b-996e-07e648dffd0c service neutron] 10.222.0.31 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1791615 Nov 15 17:49:46.938062 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:46.941332 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6ccdae31-65e3-4a19-b710-4eca9f518175,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:46.949625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.954921 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c9b34a44-8313-47bf-ad5f-5606f820de81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.968524 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d656701-79a4-4b1f-85d1-2d5e49af082d req-1a645271-372d-43b2-b08d-1349a04c965e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:46.970100 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7d656701-79a4-4b1f-85d1-2d5e49af082d req-1a645271-372d-43b2-b08d-1349a04c965e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0808456 Nov 15 17:49:46.975830 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c9b34a44-8313-47bf-ad5f-5606f820de81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.995688 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:46.998221 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.001726 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4ca482e1-e7eb-4818-bfd0-22ff88407081 HTTP/1.1" status: 204 len: 168 time: 0.4399526 Nov 15 17:49:47.027444 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-951a6688-046d-4a3d-b79d-64e4ecaf2268 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ca482e1-e7eb-4818-bfd0-22ff88407081,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:47.032625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:47.033202 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.034603 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] 10.222.0.48 "PUT /v2.0/ports/6ccdae31-65e3-4a19-b710-4eca9f518175 HTTP/1.1" status: 200 len: 1094 time: 1.1737261 Nov 15 17:49:47.035044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:47.037908 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323" -d '{"events": [{"name": "network-changed", "server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:47.042702 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8daf907-52e7-4429-942b-9c77a88424f9 service neutron] Pushing event updated for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:47.050558 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c9b34a44-8313-47bf-ad5f-5606f820de81 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=eb120387fb374984a92b62982fce27ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3150854 Nov 15 17:49:47.053622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54698) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:47.055264 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b34a44-8313-47bf-ad5f-5606f820de81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6fc48c1-1158-42f8-9e3f-d8443d9a188e,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:47.096382 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7d656701-79a4-4b1f-85d1-2d5e49af082d req-22ecc062-000a-4587-b5d2-93cc6c4bedc1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150975 Nov 15 17:49:47.194038 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.197586 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3be7936a-7118-4940-8d16-61d760eb1b66 x-openstack-request-id: req-3be7936a-7118-4940-8d16-61d760eb1b66 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:47.197907 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:47.198104 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-3be7936a-7118-4940-8d16-61d760eb1b66 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:47.198592 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175', 'status': 'completed', 'code': 200} Nov 15 17:49:47.234365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1da409f-c2b0-4fad-8c4b-09fd607c8993 req-f5aabc39-ef1b-49d3-bbce-97ed11ed6dc2 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:47.237763 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b1da409f-c2b0-4fad-8c4b-09fd607c8993 req-f5aabc39-ef1b-49d3-bbce-97ed11ed6dc2 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 944 time: 0.0938826 Nov 15 17:49:47.255978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-c90a5c75-137f-4d65-aeb3-cc271416df12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:47.257507 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-c90a5c75-137f-4d65-aeb3-cc271416df12 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 1097 time: 0.1492054 Nov 15 17:49:47.271993 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.343655 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f225aa51-a8b2-4ace-aa22-180571ad29c7 req-2fd86216-e55b-4797-a504-9d081503aba0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0811555 Nov 15 17:49:47.362253 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-83cb90cd-d632-4f9a-b993-6c4413365ea7 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6ccdae31-65e3-4a19-b710-4eca9f518175 HTTP/1.1" status: 200 len: 217 time: 0.0846930 Nov 15 17:49:47.403543 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b1da409f-c2b0-4fad-8c4b-09fd607c8993 req-489ed934-f5ec-4447-bf50-641e1faad7e9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1570246 Nov 15 17:49:47.441416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-a47822e6-1281-43cf-b920-b4d2f6ec03a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:47.442908 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-a47822e6-1281-43cf-b920-b4d2f6ec03a3 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0615444 Nov 15 17:49:47.486326 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-ebc82ffb-027e-4b4a-9c00-5bce29ac19dd service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0344825 Nov 15 17:49:47.487536 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.490569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:47.491885 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c6fc48c1-1158-42f8-9e3f-d8443d9a188e HTTP/1.1" status: 204 len: 168 time: 0.4372041 Nov 15 17:49:47.570269 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e93772-aa75-4ed8-af2a-ef4308cee060 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6fc48c1-1158-42f8-9e3f-d8443d9a188e,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:47.613481 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-dfd0c778-31a9-4700-9572-75864758e196 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1154785 Nov 15 17:49:47.767644 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-afa480d4-d599-4fcf-be5e-9a288b6a2968 req-f83fb17b-9b25-45d5-ac92-fadbadacbd7a service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415012 Nov 15 17:49:47.907105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-98af61ac-a54e-4906-83d4-4535cdcb98af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:47.908934 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-98af61ac-a54e-4906-83d4-4535cdcb98af service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 1097 time: 0.0663686 Nov 15 17:49:47.943430 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54736) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:48.021701 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-88a24c17-8350-4f00-b674-7b656e381d44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:48.024532 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-88a24c17-8350-4f00-b674-7b656e381d44 service neutron] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 916 time: 0.1037786 Nov 15 17:49:48.081232 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-3f4c721f-c442-43ca-9718-dae741d170ad service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6ccdae31-65e3-4a19-b710-4eca9f518175 HTTP/1.1" status: 200 len: 217 time: 0.0459797 Nov 15 17:49:48.129371 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7f8c2632-5a04-4ed5-9a69-b12994bb23f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.142141 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-af9a18d9-1e27-4773-9957-5eecd576fe4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:48.143826 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-af9a18d9-1e27-4773-9957-5eecd576fe4b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0511568 Nov 15 17:49:48.198088 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-ba21c3fd-8af8-4f3b-940d-59990083a472 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0442355 Nov 15 17:49:48.218659 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7f8c2632-5a04-4ed5-9a69-b12994bb23f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.224364 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7f8c2632-5a04-4ed5-9a69-b12994bb23f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.272507 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7f8c2632-5a04-4ed5-9a69-b12994bb23f1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7aa82bb83f4541639e38f0a49a21f510&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3278613 Nov 15 17:49:48.273190 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54756) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:48.279568 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8c2632-5a04-4ed5-9a69-b12994bb23f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae381402-bf8e-4d74-bff2-893b17e6a7f5,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:48.320250 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-c8e2c180-646b-4669-b459-537c8d06bf46 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1067562 Nov 15 17:49:48.333944 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.360436 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.461974 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.465026 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:48.468529 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ae381402-bf8e-4d74-bff2-893b17e6a7f5 HTTP/1.1" status: 204 len: 168 time: 0.1918564 Nov 15 17:49:48.496464 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-50cf4ad8-ec0b-4fc6-9cec-a97c43d3d323 req-74614c19-f373-425a-b3c6-d35dd71bc6dc service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1652999 Nov 15 17:49:48.506131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67768ab-5ff2-4a8a-bb0d-ce2365806200 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae381402-bf8e-4d74-bff2-893b17e6a7f5,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:48.572881 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-455673c2-75b4-40c4-83e8-aed9d955bd49 req-a5b76d4a-b17f-4aad-81f4-dd20ec79c752 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.1002278 Nov 15 17:49:48.602401 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed4eee5-093f-454e-a562-6d394e08b053 req-98b9bc7b-e60d-4860-8f53-d7e6ec0a3895 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:48.610189 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3ed4eee5-093f-454e-a562-6d394e08b053 req-98b9bc7b-e60d-4860-8f53-d7e6ec0a3895 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 944 time: 0.1006448 Nov 15 17:49:48.677934 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3ed4eee5-093f-454e-a562-6d394e08b053 req-5f50e794-545b-47ec-b134-7752ece90264 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667191 Nov 15 17:49:48.735798 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-90104a53-7cba-4ecf-9344-6e3c15c6cf9f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:48.737360 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-90104a53-7cba-4ecf-9344-6e3c15c6cf9f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 817 time: 0.1700208 Nov 15 17:49:48.858032 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-08cb617f-b8c4-4fb5-ab91-2e688f2be47c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 380 time: 0.1073058 Nov 15 17:49:48.874828 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'port': {'device_id': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'admin_state_up': True, 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'security_groups': ['80e4d0ba-b6e2-415e-9ff2-8b59489ede80']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:49.093939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-0ff4f0bb-507c-462c-8144-41e49af21843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:49.095612 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-0ff4f0bb-507c-462c-8144-41e49af21843 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0703819 Nov 15 17:49:49.099384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Made reservation on behalf of 8d7c8a074d704613bf45e1c8d95834e9 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:49:49.101092 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f173f88-abf0-4b43-910c-8e10a075bece req-25f440ea-6e89-4fb7-9720-0a5463119175 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:49.107345 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.109227 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0f173f88-abf0-4b43-910c-8e10a075bece req-25f440ea-6e89-4fb7-9720-0a5463119175 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0649309 Nov 15 17:49:49.178698 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54800) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:49.206749 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4f37f04f-f1b6-45eb-a942-061793d40ac6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.237739 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0f173f88-abf0-4b43-910c-8e10a075bece req-4d55ccc0-07a2-4678-a198-eb60c9b63d29 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274102 Nov 15 17:49:49.305059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-f93beea6-e857-4477-94f5-e3c551d41f0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:49.307142 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-f93beea6-e857-4477-94f5-e3c551d41f0e service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.1878483 Nov 15 17:49:49.344623 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4f37f04f-f1b6-45eb-a942-061793d40ac6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.354299 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4f37f04f-f1b6-45eb-a942-061793d40ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.393945 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-918fa5ad-b96b-4284-a9b7-8b02a9ea03cc service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0654719 Nov 15 17:49:49.399314 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4f37f04f-f1b6-45eb-a942-061793d40ac6 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=1660aa64b20849a0aa50b58017a4a97c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2177134 Nov 15 17:49:49.401203 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f37f04f-f1b6-45eb-a942-061793d40ac6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cbb48480-76de-42c8-bb4d-5e968f513d58,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:49.404525 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54834) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:49.467482 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.492822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.551049 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.554635 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:49.557017 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cbb48480-76de-42c8-bb4d-5e968f513d58 HTTP/1.1" status: 204 len: 168 time: 0.1505721 Nov 15 17:49:49.569404 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44dcd386-352b-43fb-a2cb-609cdf66f54f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbb48480-76de-42c8-bb4d-5e968f513d58,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:49.715733 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Allocated IP 172.20.0.6 (927b3da0-f3f2-41e8-b00d-4ab5e71093d8/82578c0d-639e-4df9-bec7-8ae336a8ba92/db874a84-aa99-4b23-9465-3c565bb54cf2) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:49:49.720861 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-92d1d71f-e00c-4f4c-b71c-ce7a88dc2e51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:49.722398 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-92d1d71f-e00c-4f4c-b71c-ce7a88dc2e51 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.3169296 Nov 15 17:49:49.765285 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-28e3b6b5-d5fe-4d72-a0a5-27a96f1bed0a req-6b7ac371-9ede-46de-b054-7efe3bd35904 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0617182 Nov 15 17:49:49.828866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56495632-b7b8-4a02-a533-3040ad1d3491 req-598d79a9-5fe5-45a6-bb56-4fd9a673c483 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:49.830405 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-56495632-b7b8-4a02-a533-3040ad1d3491 req-598d79a9-5fe5-45a6-bb56-4fd9a673c483 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 944 time: 0.0642250 Nov 15 17:49:49.872999 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-dcf7c10b-cf10-4ed3-87e1-970b5261f083 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0689428 Nov 15 17:49:49.889476 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-56495632-b7b8-4a02-a533-3040ad1d3491 req-1f6703f8-c932-49dd-bf5f-dc18ab90aec4 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524025 Nov 15 17:49:49.985427 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.019133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-9aa36c90-906d-4acb-8aaa-92f249395426 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311479 Nov 15 17:49:50.092155 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.144896 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:49:50.155914 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:49:50.169383 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:49:50.194648 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6ccdae31-65e3-4a19-b710-4eca9f518175 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:49:50.204001 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0331d9bb-7c89-4bfb-b151-8bd8ad32d8fe req-130dbb41-8de0-4c34-9d3e-084966b9c888 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1747415 Nov 15 17:49:50.213540 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:50.249981 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:50.255593 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.284111 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-b43362a2-4b96-4b51-b291-c8917176c6e8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4140286 Nov 15 17:49:50.299377 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Request body: {'port': {'device_id': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:49:50.412508 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.432830 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7a7fea-c2f5-4128-b9e4-0d93c73923cc req-ba6d63e5-22bd-4f56-999a-6feacdfa54d0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:50.434504 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ee7a7fea-c2f5-4128-b9e4-0d93c73923cc req-ba6d63e5-22bd-4f56-999a-6feacdfa54d0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.1051180 Nov 15 17:49:50.576631 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ee7a7fea-c2f5-4128-b9e4-0d93c73923cc req-bea642e5-564b-4bbe-bc87-b742977b8236 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1354620 Nov 15 17:49:50.601985 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6ccdae31-65e3-4a19-b710-4eca9f518175,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:50.621207 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '6ccdae31-65e3-4a19-b710-4eca9f518175', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'port_id': '6ccdae31-65e3-4a19-b710-4eca9f518175', 'mac_address': 'fa:16:3e:af:5e:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 431, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6a2eeae-0fac-4586-be17-093ae2e28ec5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:49:50.671736 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-d3875813-0a30-482c-be82-7cd25dd297d6 None None] Provisioning complete for port db874a84-aa99-4b23-9465-3c565bb54cf2 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:50.672366 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d3875813-0a30-482c-be82-7cd25dd297d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.721598 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.750451 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-d3875813-0a30-482c-be82-7cd25dd297d6 None None] Port db874a84-aa99-4b23-9465-3c565bb54cf2 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:49:50.752849 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6ccdae31-65e3-4a19-b710-4eca9f518175 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:50.778311 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6ccdae31-65e3-4a19-b710-4eca9f518175,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:50.783940 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.828103 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:50.836600 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.860669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Transition to ACTIVE for port object db874a84-aa99-4b23-9465-3c565bb54cf2 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:49:50.886383 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:50.888238 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:50.955939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:51.007778 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2313776b-1da1-48f0-a8cb-408e2691d6e8 req-64096ea4-a3e9-49bc-9a52-0be184d36723 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.019666 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2313776b-1da1-48f0-a8cb-408e2691d6e8 req-64096ea4-a3e9-49bc-9a52-0be184d36723 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.1343098 Nov 15 17:49:51.065363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Attempting to bind port db874a84-aa99-4b23-9465-3c565bb54cf2 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:49:51.065693 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Attempting to bind port db874a84-aa99-4b23-9465-3c565bb54cf2 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:49:51.066149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Attempting to bind port db874a84-aa99-4b23-9465-3c565bb54cf2 on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:51.072000 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Port db874a84-aa99-4b23-9465-3c565bb54cf2 on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:49:51.072450 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Attempting to bind port db874a84-aa99-4b23-9465-3c565bb54cf2 on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:49:51.079474 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:49:51.079855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Checking segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:49:51.080311 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Bound using segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:49:51.080762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Bound port: db874a84-aa99-4b23-9465-3c565bb54cf2, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:49:51.081110 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:51.157008 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2313776b-1da1-48f0-a8cb-408e2691d6e8 req-9ed81713-d5ab-41bd-84d3-a09e8b91b9e3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1354260 Nov 15 17:49:51.174576 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:49:51.177355 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2f76f4-ca0a-4fc6-9c24-889e2443e7b5 req-c8ac71ed-708e-4a96-83c8-fc903cffd209 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.178332 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:49:51.183400 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6ccdae31-65e3-4a19-b710-4eca9f518175'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:51.184766 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c2f76f4-ca0a-4fc6-9c24-889e2443e7b5 req-c8ac71ed-708e-4a96-83c8-fc903cffd209 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 945 time: 0.1279979 Nov 15 17:49:51.198498 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:51.250068 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c2f76f4-ca0a-4fc6-9c24-889e2443e7b5 req-c4c693c7-e2d9-49ef-9a90-0811caa703fe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641427 Nov 15 17:49:51.267740 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:51.281512 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.282466 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:51.283903 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-f53be4c6-a1ff-4284-9650-c31f4ddba490 service neutron] 10.222.0.48 "PUT /v2.0/ports/db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 1093 time: 0.9893265 Nov 15 17:49:51.284408 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:51.286807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73667776-6e3e-4a13-89a8-d2d68fabae62" -d '{"events": [{"name": "network-changed", "server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:51.379760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-126129fc-0089-4749-b37a-e25e9f931c83 x-openstack-request-id: req-126129fc-0089-4749-b37a-e25e9f931c83 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:51.380048 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:51.380297 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-126129fc-0089-4749-b37a-e25e9f931c83 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:51.380686 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'status': 'completed', 'code': 200} Nov 15 17:49:51.435301 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-59142976-3185-4ea7-a8ec-84a89866ba82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.436915 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-59142976-3185-4ea7-a8ec-84a89866ba82 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1096 time: 0.0860395 Nov 15 17:49:51.526569 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-069187c0-0983-40fc-b1a0-de1a8f007045 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 217 time: 0.0538542 Nov 15 17:49:51.590781 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-6fc2f4bb-b626-4bca-945c-c136b15190e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.592307 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-6fc2f4bb-b626-4bca-945c-c136b15190e0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0566335 Nov 15 17:49:51.655842 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-14035f4c-5dec-41a5-b826-675c3c21ce40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.657890 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-14035f4c-5dec-41a5-b826-675c3c21ce40 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0485682 Nov 15 17:49:51.712869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363cc6ce-bee9-4d34-b776-bcc5902d8eaf req-7dca9c24-18ee-4ddd-9d68-3d6221fc8ba6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.714381 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-363cc6ce-bee9-4d34-b776-bcc5902d8eaf req-7dca9c24-18ee-4ddd-9d68-3d6221fc8ba6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0528827 Nov 15 17:49:51.768195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-363cc6ce-bee9-4d34-b776-bcc5902d8eaf req-64c87da9-4215-4bb8-8d5d-f70d95682138 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475478 Nov 15 17:49:51.774260 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-9706aa1b-bb2c-4daf-91e1-abe8c2accc92 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974803 Nov 15 17:49:51.871865 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-906a8858-f6a4-4c83-b63c-67c9d0dd8489 req-d643f6c1-1eb0-45d5-9ab2-8d6f7e39f6c2 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885971 Nov 15 17:49:51.973212 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-b74bb885-5c6e-43ff-a3bd-999e24444c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:51.974708 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-b74bb885-5c6e-43ff-a3bd-999e24444c2c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1096 time: 0.0484672 Nov 15 17:49:52.068372 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-bd668b93-74cf-47a1-b63c-81a5a3970262 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.069853 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-bd668b93-74cf-47a1-b63c-81a5a3970262 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.0861909 Nov 15 17:49:52.125022 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-81a8aa1f-35a9-4da5-ac19-3e5f698377dc service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 217 time: 0.0386260 Nov 15 17:49:52.180426 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-e5aaaee8-315b-4b5a-99a4-82ceaf91cff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.182520 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-e5aaaee8-315b-4b5a-99a4-82ceaf91cff1 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0488284 Nov 15 17:49:52.249831 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-dbfc7d0f-e675-427b-b9a0-5ffd3865a3d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.251349 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-dbfc7d0f-e675-427b-b9a0-5ffd3865a3d3 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0593424 Nov 15 17:49:52.307750 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111bbc35-ec6b-47ec-a7a6-0d97df7df8f3 req-168330b2-ab58-4ddb-93f6-98696785597e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.308532 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:52.315565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-111bbc35-ec6b-47ec-a7a6-0d97df7df8f3 req-168330b2-ab58-4ddb-93f6-98696785597e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0806139 Nov 15 17:49:52.357285 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-9e4b9cb5-8f58-4e4c-a6a8-60b64784f032 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0968912 Nov 15 17:49:52.388161 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-111bbc35-ec6b-47ec-a7a6-0d97df7df8f3 req-68f14edd-7684-4abb-9831-a56d8ac3897c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714378 Nov 15 17:49:52.401212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e83c773-729b-4935-89dc-3442e1ee8e26 req-32154d26-98c0-4b58-9703-2a1022ff0cc7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.412765 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9e83c773-729b-4935-89dc-3442e1ee8e26 req-32154d26-98c0-4b58-9703-2a1022ff0cc7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 945 time: 0.0728581 Nov 15 17:49:52.451254 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9e83c773-729b-4935-89dc-3442e1ee8e26 req-d670497c-ec89-4c0b-a486-5275181bc0f6 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420732 Nov 15 17:49:52.451506 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73667776-6e3e-4a13-89a8-d2d68fabae62 req-f994f84b-4224-4860-b370-9750b52c2880 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863400 Nov 15 17:49:52.890194 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409652f8-414c-4dc2-87c8-6a690a4bcad3 req-8e090d58-050f-4eb8-a6a1-45e35a3ee697 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:52.891724 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-409652f8-414c-4dc2-87c8-6a690a4bcad3 req-8e090d58-050f-4eb8-a6a1-45e35a3ee697 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0536771 Nov 15 17:49:52.910218 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 54982) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:52.940714 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-409652f8-414c-4dc2-87c8-6a690a4bcad3 req-622cd73e-fc7b-48e5-b97f-eb134771bf22 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427916 Nov 15 17:49:53.015919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ed6697df-4173-4f6f-bae1-2949e9fac3a3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.095259 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ed6697df-4173-4f6f-bae1-2949e9fac3a3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.101151 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ed6697df-4173-4f6f-bae1-2949e9fac3a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.142804 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ed6697df-4173-4f6f-bae1-2949e9fac3a3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=14a03fe5528f42a69aaabd0153819fb4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2313240 Nov 15 17:49:53.143632 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed6697df-4173-4f6f-bae1-2949e9fac3a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1bacac05-d10a-4cd2-a59a-728f407b0de2,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:53.145907 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 54988) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:53.196984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.219285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.273208 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.276437 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:53.284332 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1bacac05-d10a-4cd2-a59a-728f407b0de2 HTTP/1.1" status: 204 len: 168 time: 0.1357932 Nov 15 17:49:53.293404 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-952a31b2-82ad-40f8-80d1-f1f6a0696500 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bacac05-d10a-4cd2-a59a-728f407b0de2,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:53.539781 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7300079b-6f64-40fa-bf2b-9d5a6351c768 req-f9530915-f9e2-4aa7-9978-d30363a7e75d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:53.541399 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7300079b-6f64-40fa-bf2b-9d5a6351c768 req-f9530915-f9e2-4aa7-9978-d30363a7e75d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0737753 Nov 15 17:49:53.650205 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3401edc1-a941-4dd8-bc7c-22d8168f3009 req-b8f5f10a-b865-4c11-8596-2f32c415b9ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:53.651826 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3401edc1-a941-4dd8-bc7c-22d8168f3009 req-b8f5f10a-b865-4c11-8596-2f32c415b9ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 945 time: 0.1095154 Nov 15 17:49:53.660185 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7300079b-6f64-40fa-bf2b-9d5a6351c768 req-e0ed911a-748a-434a-b8d7-acbbf91b2521 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1081438 Nov 15 17:49:53.717522 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3401edc1-a941-4dd8-bc7c-22d8168f3009 req-a88f9762-d7f5-4577-a9e7-19bf3466d10e tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563519 Nov 15 17:49:54.057442 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452578be-fa95-4246-addf-4cc4d5f56e2c req-08ba752e-2b02-4413-94bc-7afac2faf3d9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:54.058963 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-452578be-fa95-4246-addf-4cc4d5f56e2c req-08ba752e-2b02-4413-94bc-7afac2faf3d9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0512147 Nov 15 17:49:54.109697 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-452578be-fa95-4246-addf-4cc4d5f56e2c req-574f2615-a505-4fff-bfa8-8213d2923c3f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443947 Nov 15 17:49:54.211138 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:49:54.241377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6ccdae31-65e3-4a19-b710-4eca9f518175 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:54.342001 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:54.356479 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:49:54.359338 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 6ccdae31-65e3-4a19-b710-4eca9f518175 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:49:54.365498 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 6ccdae31-65e3-4a19-b710-4eca9f518175 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:54.365862 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:54.431994 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:54.449391 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:49:54.491657 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:54.499237 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:54.506693 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:54.563073 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:54.565340 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-119b94d0-2bc4-4e3e-8eba-8aa0e78012fb" -d '{"events": [{"server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "name": "network-vif-plugged", "status": "completed", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:54.585691 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6ccdae31-65e3-4a19-b710-4eca9f518175,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:54.587010 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:54.590836 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:54.622675 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf1a97d1-ec65-433c-8b17-2ced7e5b50a5 x-openstack-request-id: req-bf1a97d1-ec65-433c-8b17-2ced7e5b50a5 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:54.622955 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "name": "network-vif-plugged", "status": "completed", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:54.623235 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-bf1a97d1-ec65-433c-8b17-2ced7e5b50a5 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:54.623591 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175', 'code': 200} Nov 15 17:49:54.650928 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:54.868625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3104a9-3031-4557-81aa-7183a3e714eb req-361efde1-1d2c-4ee6-9bd1-be67068c1390 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:54.871993 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3f3104a9-3031-4557-81aa-7183a3e714eb req-361efde1-1d2c-4ee6-9bd1-be67068c1390 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 1099 time: 0.0575025 Nov 15 17:49:54.883911 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f23b8fa-210c-45b2-9fb5-d869a85a05c6 req-2752da3b-d3b2-4153-ba21-6b998c0604d1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:54.885768 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9f23b8fa-210c-45b2-9fb5-d869a85a05c6 req-2752da3b-d3b2-4153-ba21-6b998c0604d1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.1281967 Nov 15 17:49:54.911172 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796abe61-694a-4d67-bd65-69f0c715c3ca req-46c1ad8e-13b3-4443-b263-7eaa922ff857 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:54.912767 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-796abe61-694a-4d67-bd65-69f0c715c3ca req-46c1ad8e-13b3-4443-b263-7eaa922ff857 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.0873215 Nov 15 17:49:54.927030 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['db874a84-aa99-4b23-9465-3c565bb54cf2'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:49:54.955122 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3f3104a9-3031-4557-81aa-7183a3e714eb req-38369f62-7be4-4a06-9acf-cead7c207a17 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666013 Nov 15 17:49:55.033160 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9f23b8fa-210c-45b2-9fb5-d869a85a05c6 req-c58b6374-834c-49d2-aefc-ff597ec9d018 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1370242 Nov 15 17:49:55.036590 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-796abe61-694a-4d67-bd65-69f0c715c3ca req-59b33834-207a-4d0c-bea5-911a20586d65 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1091948 Nov 15 17:49:55.226640 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be47e6b0-4df6-4c8e-a816-09af6d0c5ba8 req-4b388e26-d021-4fc1-b8ee-5e581436e7ff tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:55.228128 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be47e6b0-4df6-4c8e-a816-09af6d0c5ba8 req-4b388e26-d021-4fc1-b8ee-5e581436e7ff tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0488117 Nov 15 17:49:55.284485 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-be47e6b0-4df6-4c8e-a816-09af6d0c5ba8 req-b5e9dc81-fc1c-4310-a2c1-d5b73a10603d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494194 Nov 15 17:49:56.196234 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fab0c3-ba35-4dbf-9a31-fe1bdef51415 req-cefed0f2-e625-4f1d-9a7d-2d1121e20d78 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:56.198026 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-13fab0c3-ba35-4dbf-9a31-fe1bdef51415 req-cefed0f2-e625-4f1d-9a7d-2d1121e20d78 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.0781393 Nov 15 17:49:56.220494 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51be5e1d-e508-42f1-96e6-5face9014040 req-31247c52-62c0-4ea7-9c73-ab35bed1628a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:56.224142 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51be5e1d-e508-42f1-96e6-5face9014040 req-31247c52-62c0-4ea7-9c73-ab35bed1628a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0781357 Nov 15 17:49:56.233845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:49:56.289280 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port db874a84-aa99-4b23-9465-3c565bb54cf2 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:49:56.294754 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port db874a84-aa99-4b23-9465-3c565bb54cf2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:49:56.295165 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-13fab0c3-ba35-4dbf-9a31-fe1bdef51415 req-75d0c3ab-00e4-4d1b-b537-26a2f91b712b tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909102 Nov 15 17:49:56.296020 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.303654 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51be5e1d-e508-42f1-96e6-5face9014040 req-f4331468-ff1e-4beb-8a54-a992c360dd08 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711682 Nov 15 17:49:56.420846 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.460427 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d031ae7-77ff-4e27-b21c-66a02a7143a4 req-9d70eade-e67f-4696-8707-246c52637e2a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:56.462694 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9d031ae7-77ff-4e27-b21c-66a02a7143a4 req-9d70eade-e67f-4696-8707-246c52637e2a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0792248 Nov 15 17:49:56.477921 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:49:56.482334 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.518928 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9d031ae7-77ff-4e27-b21c-66a02a7143a4 req-961f0def-cb23-4d11-ba91-21f3af0fa356 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498343 Nov 15 17:49:56.535965 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:56.550847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55108) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:56.625383 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:49:56.627853 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-561fd62a-8251-4fc9-8414-29457e398ec2" -d '{"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:49:56.667240 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d887c3d-94d5-4c0b-9c6c-04e616e3bbd9 x-openstack-request-id: req-5d887c3d-94d5-4c0b-9c6c-04e616e3bbd9 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:49:56.667557 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:49:56.667857 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-5d887c3d-94d5-4c0b-9c6c-04e616e3bbd9 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:49:56.668258 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'code': 200} Nov 15 17:49:56.670787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1613471-d776-4841-820f-e4ff827b2c6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.754574 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1613471-d776-4841-820f-e4ff827b2c6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.759834 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1613471-d776-4841-820f-e4ff827b2c6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.807968 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1613471-d776-4841-820f-e4ff827b2c6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eca60df3-87a9-49ad-b099-3fa4a6e82604,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:56.816771 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b1613471-d776-4841-820f-e4ff827b2c6c admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=047ab98710254b44ad6a0a753c5ab63a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2622008 Nov 15 17:49:56.817195 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55128) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:56.876488 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.903477 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.906957 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8075eba4-c39b-41db-8b47-aa55ff2c4ed5 req-642629c9-beaf-409a-b160-bbbf555dd5f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:56.908875 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8075eba4-c39b-41db-8b47-aa55ff2c4ed5 req-642629c9-beaf-409a-b160-bbbf555dd5f1 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1098 time: 0.0575056 Nov 15 17:49:56.956911 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8075eba4-c39b-41db-8b47-aa55ff2c4ed5 req-3cee9493-953f-4e5e-8d91-59b4e23f7e18 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392098 Nov 15 17:49:56.958004 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.960912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:56.962063 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/eca60df3-87a9-49ad-b099-3fa4a6e82604 HTTP/1.1" status: 204 len: 168 time: 0.1443539 Nov 15 17:49:56.970206 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f69cd3-db53-42ba-ab8d-78a714c4fc62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eca60df3-87a9-49ad-b099-3fa4a6e82604,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:57.240593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55136) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:57.259581 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-22d04bb6-f4dc-4bb6-8a19-0089761cf070 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.340162 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-22d04bb6-f4dc-4bb6-8a19-0089761cf070 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.345586 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-22d04bb6-f4dc-4bb6-8a19-0089761cf070 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.417124 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-22d04bb6-f4dc-4bb6-8a19-0089761cf070 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b7af86e645fe40ef8b216e5d23787bf0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1747379 Nov 15 17:49:57.417760 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d04bb6-f4dc-4bb6-8a19-0089761cf070 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0c0b35f-85b3-416b-8ced-a44d181c72b3,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:57.419964 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55142) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:49:57.471854 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82df5158-8ddc-4a2a-977b-b38466e0b224 req-9a585baa-574f-47d7-b610-c1bd5c579f11 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:57.473330 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-82df5158-8ddc-4a2a-977b-b38466e0b224 req-9a585baa-574f-47d7-b610-c1bd5c579f11 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.1011372 Nov 15 17:49:57.484829 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e16e368-d249-4237-90cb-c60e3897d449 req-8da185ca-762d-4fd2-b46e-55f0482dded4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:57.486454 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e16e368-d249-4237-90cb-c60e3897d449 req-8da185ca-762d-4fd2-b46e-55f0482dded4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0968595 Nov 15 17:49:57.488967 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.512819 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.564343 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-82df5158-8ddc-4a2a-977b-b38466e0b224 req-2aa42492-8a49-4240-b62a-539e53b7a9d5 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768960 Nov 15 17:49:57.569349 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.572689 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:49:57.574187 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/b0c0b35f-85b3-416b-8ced-a44d181c72b3 HTTP/1.1" status: 204 len: 168 time: 0.1529515 Nov 15 17:49:57.577220 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e16e368-d249-4237-90cb-c60e3897d449 req-4ee3e3dd-a5e4-4d03-b1c7-0586f01500f8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741527 Nov 15 17:49:57.583135 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4fa262a-5e5d-4d70-a7ca-995997db8674 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0c0b35f-85b3-416b-8ced-a44d181c72b3,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:49:57.758954 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080d702a-fa32-48a3-93eb-0b834b8abf3a req-fa224dd7-8e36-40e4-80e4-c920a301e764 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:57.760624 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-080d702a-fa32-48a3-93eb-0b834b8abf3a req-fa224dd7-8e36-40e4-80e4-c920a301e764 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0591226 Nov 15 17:49:57.822968 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-080d702a-fa32-48a3-93eb-0b834b8abf3a req-93a48841-dc39-46a2-99ad-85218eb830cb tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488484 Nov 15 17:49:58.046867 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:49:58.759435 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f83f5da2-f8b4-4fc3-b032-587933c043d2 req-06901036-fe07-46b4-ab49-d01829a9d90a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:58.761791 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f83f5da2-f8b4-4fc3-b032-587933c043d2 req-06901036-fe07-46b4-ab49-d01829a9d90a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0703111 Nov 15 17:49:59.087360 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f83f5da2-f8b4-4fc3-b032-587933c043d2 req-8438e77d-55eb-4334-a7f2-bf8f1d2ccddd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3189583 Nov 15 17:49:59.100975 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac60f3c9-4fd8-4d29-9632-ef7e905375f2 req-2586c875-18e9-41c8-bb16-08cc7f209020 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:49:59.102463 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ac60f3c9-4fd8-4d29-9632-ef7e905375f2 req-2586c875-18e9-41c8-bb16-08cc7f209020 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0719998 Nov 15 17:49:59.173590 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ac60f3c9-4fd8-4d29-9632-ef7e905375f2 req-59ead9b7-c8f4-476e-8710-3b4affaf6f89 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644281 Nov 15 17:50:00.223582 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31868b1-5bb1-4a77-b582-3ee81fd5048e req-9c9ee146-f927-4f10-b3bb-7df9cc237a7c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:00.225112 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b31868b1-5bb1-4a77-b582-3ee81fd5048e req-9c9ee146-f927-4f10-b3bb-7df9cc237a7c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0498044 Nov 15 17:50:00.299856 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b31868b1-5bb1-4a77-b582-3ee81fd5048e req-de95e7f2-2ee7-4215-a5ec-05896d3cdee0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0685401 Nov 15 17:50:00.315607 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00bdcdc-e27c-4309-9883-fa8b3181b391 req-99b868d7-6d4f-4c0b-afa0-77a7bdde1985 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:00.317091 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a00bdcdc-e27c-4309-9883-fa8b3181b391 req-99b868d7-6d4f-4c0b-afa0-77a7bdde1985 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0692043 Nov 15 17:50:00.365715 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a00bdcdc-e27c-4309-9883-fa8b3181b391 req-4be377d4-a159-401e-bbe9-3c97828acc34 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424814 Nov 15 17:50:00.415248 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2b81e9-6bf9-4a14-889a-812bb658ac37 req-d14b2642-a507-46cc-8208-143ae339d494 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:00.417014 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4a2b81e9-6bf9-4a14-889a-812bb658ac37 req-d14b2642-a507-46cc-8208-143ae339d494 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0492685 Nov 15 17:50:00.427540 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55242) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:00.432069 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'floatingip': {'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:00.509949 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:00.785447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a1979962-7c80-4c53-aac8-16b92c90f2de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.107594 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.112219 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.219641 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Floating IP bc4db52c-d6d8-49df-9712-b317100d67f3 associated. External IP: 172.27.0.110, port: db874a84-aa99-4b23-9465-3c565bb54cf2. Nov 15 17:50:01.435539 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:50:01.473887 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55276) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:01.586209 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-705b8721-78ad-4179-94c2-5f8aff5dd15d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.690050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-705b8721-78ad-4179-94c2-5f8aff5dd15d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.694395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-705b8721-78ad-4179-94c2-5f8aff5dd15d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.734198 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-705b8721-78ad-4179-94c2-5f8aff5dd15d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=059c58a59d884260856277f1f9351e6e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2598150 Nov 15 17:50:01.735193 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705b8721-78ad-4179-94c2-5f8aff5dd15d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=978d8bcb-0b6a-4f6d-844c-95532af64d34,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:01.737536 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55284) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:01.764544 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdcca62-4082-436c-ad86-9b903eeaa939 req-19792090-b44d-4f31-8c42-3c323bfb8622 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:01.766086 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7cdcca62-4082-436c-ad86-9b903eeaa939 req-19792090-b44d-4f31-8c42-3c323bfb8622 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.3278921 Nov 15 17:50:01.787977 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.809910 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.816464 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:50:01.824233 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.827640 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:50:01.838746 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:50:01.839484 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:50:01.846874 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7cdcca62-4082-436c-ad86-9b903eeaa939 req-2f1e260c-2f30-4993-9f62-b2d78a754bc5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729516 Nov 15 17:50:01.864570 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.868671 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9b2dc954-3f3e-4fdb-8122-cd539942efb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "PUT /v2.0/floatingips/bc4db52c-d6d8-49df-9712-b317100d67f3 HTTP/1.1" status: 200 len: 991 time: 1.4374883 Nov 15 17:50:01.868671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:01.869287 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:01.869791 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65ceca6b-65ac-47b0-a915-805b5e0536f3" -d '{"events": [{"name": "network-changed", "server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:01.872379 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/978d8bcb-0b6a-4f6d-844c-95532af64d34 HTTP/1.1" status: 204 len: 168 time: 0.1336999 Nov 15 17:50:01.883572 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51c36d22-91ff-4772-a4c6-8a63a959334d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=978d8bcb-0b6a-4f6d-844c-95532af64d34,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:01.928137 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9955273-4797-4076-a450-6b0b28068ab5 x-openstack-request-id: req-f9955273-4797-4076-a450-6b0b28068ab5 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:01.928926 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:01.929332 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f9955273-4797-4076-a450-6b0b28068ab5 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:01.929977 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'status': 'completed', 'code': 200} Nov 15 17:50:02.042191 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-2061251e-79ba-4b5f-837e-4a470393163c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:02.044936 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-2061251e-79ba-4b5f-837e-4a470393163c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1098 time: 0.0562344 Nov 15 17:50:02.096649 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:50:02.153625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-a3bb9b3a-81b0-4f5d-ab12-0f13b598dac0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:02.156206 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-a3bb9b3a-81b0-4f5d-ab12-0f13b598dac0 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.0987167 Nov 15 17:50:02.274012 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-1741cf9b-b3aa-4ed3-838c-8cac5bf2418b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 999 time: 0.1063511 Nov 15 17:50:02.338129 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-b8168d7e-4c1e-46db-b1d3-8cbac0bf038b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:02.339597 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-b8168d7e-4c1e-46db-b1d3-8cbac0bf038b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0557382 Nov 15 17:50:02.341685 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55312) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:02.371058 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'bc4db52c-d6d8-49df-9712-b317100d67f3', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.110', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 294, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:49:44Z', 'updated_at': '2021-11-15T17:50:00Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:50:02.399769 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:50:02.409629 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:50:02.410475 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:49:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:50:02.413671 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-5bd8af5e-0ed2-4143-b964-3b456e8f34e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:02.416379 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-5bd8af5e-0ed2-4143-b964-3b456e8f34e4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0500677 Nov 15 17:50:02.522512 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-eb2314a7-ae41-43f4-afbd-616e1e38e76e service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973599 Nov 15 17:50:02.549199 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:50:02.589974 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fdc00b5c-ecf0-4792-92f2-d71eb5f5ce35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.704891 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65ceca6b-65ac-47b0-a915-805b5e0536f3 req-6e9ecfc4-5c3a-47e0-a0ad-9bc8d4474522 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1626852 Nov 15 17:50:02.739329 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fdc00b5c-ecf0-4792-92f2-d71eb5f5ce35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.744904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fdc00b5c-ecf0-4792-92f2-d71eb5f5ce35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.787987 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-fdc00b5c-ecf0-4792-92f2-d71eb5f5ce35 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d4fc9921db2a4fb296ddb18bdb3f5564&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4426305 Nov 15 17:50:02.787987 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc00b5c-ecf0-4792-92f2-d71eb5f5ce35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96c9a9de-af78-4525-b835-1fa0caf184bb,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:02.788367 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55330) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:02.821386 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'bc4db52c-d6d8-49df-9712-b317100d67f3', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.110', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 294, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:49:44Z', 'updated_at': '2021-11-15T17:50:00Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:50:02.844593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.850991 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca51dc34-9f12-4d6b-b110-adf4031a6899 None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'bc4db52c-d6d8-49df-9712-b317100d67f3', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.110', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 294, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:49:44Z', 'updated_at': '2021-11-15T17:50:00Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:50:02.867342 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.929331 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.932468 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:02.933644 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/96c9a9de-af78-4525-b835-1fa0caf184bb HTTP/1.1" status: 204 len: 168 time: 0.1437712 Nov 15 17:50:02.964080 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b3db4b-0959-479e-8dc6-eb43967d4e33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96c9a9de-af78-4525-b835-1fa0caf184bb,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:03.076879 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d5bb9a4b-4832-429f-98c6-406776cfec45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.181039 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06233e5e-452d-43f1-b41c-05814dc1dc86 None None] New status for floating IP bc4db52c-d6d8-49df-9712-b317100d67f3: ACTIVE {{(pid=108143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:50:03.206285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b537982-27f2-413b-8aa8-9049065cb3cc req-aeea4cb5-75b1-456f-ae22-226270ddfbcd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:03.207996 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b537982-27f2-413b-8aa8-9049065cb3cc req-aeea4cb5-75b1-456f-ae22-226270ddfbcd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0696507 Nov 15 17:50:03.289400 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b537982-27f2-413b-8aa8-9049065cb3cc req-58ced54f-3cc8-450b-aa79-e371c60f1f40 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730736 Nov 15 17:50:03.416127 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55356) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:03.432268 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1cf7a3e2-f43f-429e-82d1-a7b07d67ea71 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.529875 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1cf7a3e2-f43f-429e-82d1-a7b07d67ea71 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.534585 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-1cf7a3e2-f43f-429e-82d1-a7b07d67ea71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.565963 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-1cf7a3e2-f43f-429e-82d1-a7b07d67ea71 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=18fb8f123e5745a9ac0b1865bbe0799c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1486619 Nov 15 17:50:03.568771 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55362) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:03.578314 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf7a3e2-f43f-429e-82d1-a7b07d67ea71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13c74750-64fc-4df9-9abb-758c2517c8b3,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:03.620108 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.642231 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.691724 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.693781 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:03.694983 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/13c74750-64fc-4df9-9abb-758c2517c8b3 HTTP/1.1" status: 204 len: 168 time: 0.1251328 Nov 15 17:50:03.703461 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51ba6b68-374a-46da-894d-4e3bab43f834 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13c74750-64fc-4df9-9abb-758c2517c8b3,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:04.058076 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55372) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:04.076464 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ccd5ad-9ece-4d1c-b219-77a99d2e2bc7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.155119 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ccd5ad-9ece-4d1c-b219-77a99d2e2bc7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.160404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-55ccd5ad-9ece-4d1c-b219-77a99d2e2bc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.199069 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-55ccd5ad-9ece-4d1c-b219-77a99d2e2bc7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=151c4736e07a4eec97e052b74af78d99&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1395128 Nov 15 17:50:04.199941 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ccd5ad-9ece-4d1c-b219-77a99d2e2bc7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfb95e13-17bd-410b-a2f9-26e3a5f721e8,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:04.201792 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55376) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:04.253267 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.278948 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.334400 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.337067 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.338236 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/dfb95e13-17bd-410b-a2f9-26e3a5f721e8 HTTP/1.1" status: 204 len: 168 time: 0.1348317 Nov 15 17:50:04.346426 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ed53a5-f47f-4101-8b6e-f778f441c8fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfb95e13-17bd-410b-a2f9-26e3a5f721e8,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:04.396131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-350c0a5d-6db5-4e44-a433-d3e3af685abe req-6f083527-70a5-4b44-9044-658f4041ad8b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:04.397856 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-350c0a5d-6db5-4e44-a433-d3e3af685abe req-6f083527-70a5-4b44-9044-658f4041ad8b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0493529 Nov 15 17:50:04.449983 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:04.451066 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-350c0a5d-6db5-4e44-a433-d3e3af685abe req-14731dcd-cbc4-44d5-97bc-3d3d01fff93a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470693 Nov 15 17:50:05.089659 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55418) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:05.190924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-337106524-network', 'tenant_id': '4f592f6fa5d14c7b91a773d7f8a2f295'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:05.213528 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Made reservation on behalf of 4f592f6fa5d14c7b91a773d7f8a2f295 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:50:05.216201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.224956 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.305637 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.312124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.340718 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] vlan segment allocate from pool success with {'vlan_id': 446, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:50:05.350456 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef9e1c0c-0ed0-4993-8ecb-6610248183a9,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:05.356847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.357182 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Added segment 87006e21-df9a-4769-925c-1d4d72189624 of type vlan for network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b Nov 15 17:50:05.398465 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.430914 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.431931 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:05.432779 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.486457 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3928950 Nov 15 17:50:05.487001 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55426) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:05.492856 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Request body: {'subnet': {'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-337106524-subnet', 'tenant_id': '4f592f6fa5d14c7b91a773d7f8a2f295', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:05.497021 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0b2517-999c-4dc9-9386-719e8f516efc admin admin] Pushing event updated for resources: {'Network': ['ID=840a23aa-77b8-4f10-9b9f-7b064a15ef6b,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:05.507086 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:50:05.517969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Made reservation on behalf of 4f592f6fa5d14c7b91a773d7f8a2f295 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:50:05.520972 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.579779 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0611487-38ca-4472-be22-5e00a9a08f6f req-2b16954b-4708-4656-9d76-c00ea4d6b44f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:05.581812 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f0611487-38ca-4472-be22-5e00a9a08f6f req-2b16954b-4708-4656-9d76-c00ea4d6b44f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0606525 Nov 15 17:50:05.582176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.632674 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f0611487-38ca-4472-be22-5e00a9a08f6f req-04c35387-1339-4b29-a12c-d430241b447b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446711 Nov 15 17:50:05.702606 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.749560 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7424951c-80da-4659-9a6c-ca7b2ec6e17a,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:05.764771 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Checking segment: {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:50:05.765137 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Network hostable DHCP agents. Network: 840a23aa-77b8-4f10-9b9f-7b064a15ef6b, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:50:05.783595 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:50:05.800789 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 840a23aa-77b8-4f10-9b9f-7b064a15ef6b) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:50:05.805639 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:05.807115 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:05.811846 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bbc8fdc-9571-494d-8e82-da92b3626878 None None] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:50:05.826077 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-48faa6f2-6150-426a-8241-5473e98a0833 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3375947 Nov 15 17:50:05.965656 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3d9d778-dbc6-41ce-bd5f-9aba2c5eccae None None] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:50:06.668589 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:06.758495 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89cac164-51c4-42ad-bdef-6fa31211c7f7 req-4ddc489b-aae6-4ca2-9be3-4dccbac21573 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:06.760154 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-89cac164-51c4-42ad-bdef-6fa31211c7f7 req-4ddc489b-aae6-4ca2-9be3-4dccbac21573 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0555861 Nov 15 17:50:06.824863 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-89cac164-51c4-42ad-bdef-6fa31211c7f7 req-94cf7c55-9731-4d97-806e-d55ef2a2047b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522416 Nov 15 17:50:07.956120 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4e6b68-32e7-41a1-9e93-321eced025ed req-bab26e5f-5d35-477c-8f5c-555279704a43 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:07.957637 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b4e6b68-32e7-41a1-9e93-321eced025ed req-bab26e5f-5d35-477c-8f5c-555279704a43 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0548420 Nov 15 17:50:08.013774 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b4e6b68-32e7-41a1-9e93-321eced025ed req-f1c32818-148d-4900-8df2-07abc7ff90a5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449429 Nov 15 17:50:09.164606 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0fc07a-25ee-4ad2-8573-0962dfd6d3c1 req-afaedfe4-6e72-48b9-a919-f6b3ea87f847 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:09.166225 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1f0fc07a-25ee-4ad2-8573-0962dfd6d3c1 req-afaedfe4-6e72-48b9-a919-f6b3ea87f847 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0614755 Nov 15 17:50:09.240413 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1f0fc07a-25ee-4ad2-8573-0962dfd6d3c1 req-d7271af7-f606-49ee-9291-f01f86f25341 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674818 Nov 15 17:50:09.683115 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-d7f314b8-a273-47f4-bd1d-8f5fb07640ce tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:09.684612 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-d7f314b8-a273-47f4-bd1d-8f5fb07640ce tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 808 time: 0.1083605 Nov 15 17:50:09.700423 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-a7d75c0d-03dd-44a9-a6a8-7580d1dbcfce tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/quotas/4f592f6fa5d14c7b91a773d7f8a2f295 HTTP/1.1" status: 200 len: 375 time: 0.0098031 Nov 15 17:50:09.732703 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-c4df1855-c4cc-4ad3-8140-38960f591702 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0270371 Nov 15 17:50:09.829114 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-751ea47d-ad86-438f-a2ac-91e14d9715fe service neutron] 10.222.0.31 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891621 Nov 15 17:50:09.923295 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-5e3ff0c8-233b-43ee-9212-a65a8eb30237 service neutron] 10.222.0.31 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878792 Nov 15 17:50:10.082147 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cf393ce1-d6ba-4e8f-98ca-345e8851d4b0 req-2c1b3f62-fd84-48fe-997a-100659598935 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 210 time: 0.0281353 Nov 15 17:50:10.368501 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0a0e1a-9294-4029-b998-85fe776fbc41 req-7dbdaffe-9d78-40e8-a1d4-1a1be880147e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:10.373128 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2d0a0e1a-9294-4029-b998-85fe776fbc41 req-7dbdaffe-9d78-40e8-a1d4-1a1be880147e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0547779 Nov 15 17:50:10.441375 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2d0a0e1a-9294-4029-b998-85fe776fbc41 req-e11864e6-9337-4480-af9c-899d2f873b5c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646508 Nov 15 17:50:11.180115 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5df1e8a9-61ce-4551-9402-38c67c2e0ffa req-4bacf030-000d-444c-8ace-b8da64248ef1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 210 time: 0.0268006 Nov 15 17:50:11.498105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-fed2a2f7-e945-40a3-bdd9-1d9b998232ec tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:11.499680 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-fed2a2f7-e945-40a3-bdd9-1d9b998232ec tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 808 time: 0.1115620 Nov 15 17:50:11.533224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Request body: {'port': {'device_id': 'dd1210ce-2546-422e-b533-44c48249570c', 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b', 'admin_state_up': True, 'tenant_id': '4f592f6fa5d14c7b91a773d7f8a2f295'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:11.569837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da31ecdb-839f-4170-bebb-21d9fb0de0cf req-f4a1c5ab-7f42-48be-88ea-76d54803b9c7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:11.571319 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-da31ecdb-839f-4170-bebb-21d9fb0de0cf req-f4a1c5ab-7f42-48be-88ea-76d54803b9c7 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0568256 Nov 15 17:50:11.628619 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-da31ecdb-839f-4170-bebb-21d9fb0de0cf req-1490dc85-fd18-4527-9313-bae5c343610b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499601 Nov 15 17:50:11.656523 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Made reservation on behalf of 4f592f6fa5d14c7b91a773d7f8a2f295 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:50:11.660439 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.749823 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55588) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:11.792530 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Allocated IP 172.20.0.5 (840a23aa-77b8-4f10-9b9f-7b064a15ef6b/7424951c-80da-4659-9a6c-ca7b2ec6e17a/c742091c-5ad8-49e8-b633-54ed6dfb354b) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:50:11.857343 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963a9ab9-15b4-4b9d-b090-033b78bd95f8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.933932 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963a9ab9-15b4-4b9d-b090-033b78bd95f8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.939144 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963a9ab9-15b4-4b9d-b090-033b78bd95f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.943627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.978024 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:11.978780 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-963a9ab9-15b4-4b9d-b090-033b78bd95f8 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=885906ca2593439fbcdf2001324822a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2277639 Nov 15 17:50:11.979969 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-963a9ab9-15b4-4b9d-b090-033b78bd95f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eea50422-20a7-4b59-96e5-f31aa62d4005,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:11.981677 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 55594) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:12.059540 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:50:12.065965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:50:12.068268 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Pushing event updated for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:12.070540 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:50:12.121501 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.140280 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:12.140879 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.160531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.172023 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-62ace1e2-eb13-4697-8d8e-aae41417ecb1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6469195 Nov 15 17:50:12.197600 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Request body: {'port': {'device_id': 'dd1210ce-2546-422e-b533-44c48249570c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:12.256104 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.265694 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.268362 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.269488 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/eea50422-20a7-4b59-96e5-f31aa62d4005 HTTP/1.1" status: 204 len: 168 time: 0.2868733 Nov 15 17:50:12.282014 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4284fb9f-31f3-4241-b371-5f29db539572 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eea50422-20a7-4b59-96e5-f31aa62d4005,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:12.322068 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6223dabd-7f1b-4567-a8e2-2b15c456d980 req-2c005c64-5b90-4827-9c8c-7c8463f5e9c9 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:12.329796 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6223dabd-7f1b-4567-a8e2-2b15c456d980 req-2c005c64-5b90-4827-9c8c-7c8463f5e9c9 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 931 time: 0.0682461 Nov 15 17:50:12.396167 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6223dabd-7f1b-4567-a8e2-2b15c456d980 req-48cdcf88-7070-4734-bb77-82ab05ba18eb tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635767 Nov 15 17:50:12.492189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbbeea3-4000-4741-9898-1b6aac57df49 req-44226ad8-dc5c-40e0-b9cb-a6224a03905c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:12.494110 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9fbbeea3-4000-4741-9898-1b6aac57df49 req-44226ad8-dc5c-40e0-b9cb-a6224a03905c service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0945499 Nov 15 17:50:12.574132 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9fbbeea3-4000-4741-9898-1b6aac57df49 req-1e609dce-45af-4c39-baa9-f5d92469e117 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685260 Nov 15 17:50:12.615927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c742091c-5ad8-49e8-b633-54ed6dfb354b {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:12.624060 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.637000 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Transition to ACTIVE for port object c742091c-5ad8-49e8-b633-54ed6dfb354b will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:50:12.642538 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:12.695485 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Pushing event updated for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:12.757441 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7caaa1-c2f3-416a-b110-4a860d06139b req-dd4d1bf7-ae7e-4ca1-a53c-123bf4c42df1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:12.759919 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9d7caaa1-c2f3-416a-b110-4a860d06139b req-dd4d1bf7-ae7e-4ca1-a53c-123bf4c42df1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0581856 Nov 15 17:50:12.814715 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9d7caaa1-c2f3-416a-b110-4a860d06139b req-11658f2c-cbdd-4b53-9255-5fd78a0ee552 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475159 Nov 15 17:50:12.998030 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Attempting to bind port c742091c-5ad8-49e8-b633-54ed6dfb354b on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:50:12.998369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Attempting to bind port c742091c-5ad8-49e8-b633-54ed6dfb354b by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:50:12.998700 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Attempting to bind port c742091c-5ad8-49e8-b633-54ed6dfb354b on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:13.003515 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Port c742091c-5ad8-49e8-b633-54ed6dfb354b on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:50:13.003871 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Attempting to bind port c742091c-5ad8-49e8-b633-54ed6dfb354b on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:13.008814 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 49, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:50:13.009156 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Checking segment: {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:50:13.009542 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Bound using segment: {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:50:13.009938 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Bound port: c742091c-5ad8-49e8-b633-54ed6dfb354b, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:50:13.010517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:13.074085 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:50:13.077229 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:50:13.081231 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:13.117173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.117782 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:13.119574 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] 10.222.0.48 "PUT /v2.0/ports/c742091c-5ad8-49e8-b633-54ed6dfb354b HTTP/1.1" status: 200 len: 1093 time: 0.9280527 Nov 15 17:50:13.120153 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:13.122454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a42531c3-0dd6-4c71-bc53-eea195e31207" -d '{"events": [{"name": "network-changed", "server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:13.143468 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c39c43b-f2c2-41a8-ae6e-95d81a407a7a service neutron] Pushing event updated for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:13.168326 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afcd1b04-faa4-4985-9640-cc51d7789481 x-openstack-request-id: req-afcd1b04-faa4-4985-9640-cc51d7789481 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:13.168621 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:13.168847 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-afcd1b04-faa4-4985-9640-cc51d7789481 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:13.169247 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b', 'status': 'completed', 'code': 200} Nov 15 17:50:13.220635 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-339e72f0-271d-4d4f-9bbf-01e9ed7c0fab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.222115 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-339e72f0-271d-4d4f-9bbf-01e9ed7c0fab service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 1096 time: 0.0464144 Nov 15 17:50:13.264442 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-ede88518-baf0-45aa-af87-87eb6d35aaf9 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b HTTP/1.1" status: 200 len: 217 time: 0.0338376 Nov 15 17:50:13.320931 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-9c448f0a-4bfb-4dee-9ac6-ca2734e1b6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.322412 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-9c448f0a-4bfb-4dee-9ac6-ca2734e1b6ab service neutron] 10.222.0.48 "GET /v2.0/subnets?id=7424951c-80da-4659-9a6c-ca7b2ec6e17a HTTP/1.1" status: 200 len: 848 time: 0.0448673 Nov 15 17:50:13.358546 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-e03d5f4c-ec96-4e74-9739-bf5ef944618a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272183 Nov 15 17:50:13.452875 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-350bd088-7651-41b5-995d-97867fec23d3 service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853434 Nov 15 17:50:13.506827 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8462b5d4-4668-458c-87f0-9401953f3ebe req-b92228bb-9482-4055-bc79-402355fca46f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.508278 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8462b5d4-4668-458c-87f0-9401953f3ebe req-b92228bb-9482-4055-bc79-402355fca46f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 943 time: 0.0482194 Nov 15 17:50:13.548601 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-784e79c4-01dc-4af5-b680-4bd86e7b435b req-dfd5b2d7-b579-47f7-a937-cd6091ede2ca service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874465 Nov 15 17:50:13.555443 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8462b5d4-4668-458c-87f0-9401953f3ebe req-da611a88-acd0-4414-884d-5a83a8cc5b84 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406773 Nov 15 17:50:13.643843 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-993b4d62-7a17-42d4-b875-8ca5663a44a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.645947 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-993b4d62-7a17-42d4-b875-8ca5663a44a8 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 1096 time: 0.0432842 Nov 15 17:50:13.773150 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-303e534a-1a68-4f23-8857-055d06307bdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.774628 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-303e534a-1a68-4f23-8857-055d06307bdb service neutron] 10.222.0.48 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 909 time: 0.1008480 Nov 15 17:50:13.823213 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-6a992061-ee25-4eff-b383-b0a10b1310d6 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b HTTP/1.1" status: 200 len: 217 time: 0.0344050 Nov 15 17:50:13.880226 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-d27d328e-fad8-4afd-963b-efd5318829bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.881697 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-d27d328e-fad8-4afd-963b-efd5318829bb service neutron] 10.222.0.48 "GET /v2.0/subnets?id=7424951c-80da-4659-9a6c-ca7b2ec6e17a HTTP/1.1" status: 200 len: 848 time: 0.0446823 Nov 15 17:50:13.918151 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-a0955984-5faa-4e2d-b7ba-e3c5e7d0e473 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239670 Nov 15 17:50:13.942763 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402a3606-48a1-480f-a633-b68779ef31d1 req-f8a47039-7183-4d39-b852-1e8c14452b5e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:13.944438 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-402a3606-48a1-480f-a633-b68779ef31d1 req-f8a47039-7183-4d39-b852-1e8c14452b5e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0549476 Nov 15 17:50:13.991245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-402a3606-48a1-480f-a633-b68779ef31d1 req-41d4c454-6821-4b3e-89f7-986795735561 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406988 Nov 15 17:50:14.017339 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-009c7d6f-b484-4bde-b0ef-a9aa7e74047d service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887406 Nov 15 17:50:14.116799 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a42531c3-0dd6-4c71-bc53-eea195e31207 req-380398dd-60cf-41dd-858d-2fb581e017d9 service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850301 Nov 15 17:50:14.678116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9030a5bb-4a8b-47a1-b211-bdac2f864f22 req-de75f47a-4a04-413a-9281-bbfed93d8f30 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:14.679613 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9030a5bb-4a8b-47a1-b211-bdac2f864f22 req-de75f47a-4a04-413a-9281-bbfed93d8f30 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 943 time: 0.0512710 Nov 15 17:50:14.727080 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9030a5bb-4a8b-47a1-b211-bdac2f864f22 req-16057e98-5244-4041-a422-efb51ee18eb7 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412788 Nov 15 17:50:15.116877 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb415d1-18d0-4c79-a877-bea901d8312b req-cb667ddd-3731-4faa-ba85-01fe0f2025fe tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.118280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bfb415d1-18d0-4c79-a877-bea901d8312b req-cb667ddd-3731-4faa-ba85-01fe0f2025fe tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0564280 Nov 15 17:50:15.166166 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bfb415d1-18d0-4c79-a877-bea901d8312b req-87fc81b3-fb6c-43dc-b8f0-39112096ad85 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411229 Nov 15 17:50:15.419561 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-d7b4f888-7dea-43cb-834f-3b8da1336f92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.421254 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-d7b4f888-7dea-43cb-834f-3b8da1336f92 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0489223 Nov 15 17:50:15.429377 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ec8238-1287-403b-8dd1-4fb2f397299c req-0ea10b13-bcf2-4753-93f5-8482b7c42cb4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.430878 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c2ec8238-1287-403b-8dd1-4fb2f397299c req-0ea10b13-bcf2-4753-93f5-8482b7c42cb4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0503185 Nov 15 17:50:15.489050 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c2ec8238-1287-403b-8dd1-4fb2f397299c req-eb15abe8-0367-41ab-81a5-490c2767f50a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518856 Nov 15 17:50:15.537253 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-f0176a00-77fb-4442-a124-cd5f9189264e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.538699 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-f0176a00-77fb-4442-a124-cd5f9189264e service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.1013889 Nov 15 17:50:15.581740 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-f42f0f2e-1d6d-4538-850e-087cad553cb9 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0323241 Nov 15 17:50:15.632336 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-e7aed785-f6a1-4db9-b65e-e74ca2ad8369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.633814 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-e7aed785-f6a1-4db9-b65e-e74ca2ad8369 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0445542 Nov 15 17:50:15.665963 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-ab5eaf84-19e3-43e6-82ad-a76603bdc596 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235679 Nov 15 17:50:15.784272 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-8ef1c527-2da2-498b-b938-50ce2747e50c service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966897 Nov 15 17:50:15.847208 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f03236-302b-473a-b161-9efc541d8a98 req-b6231e70-23a8-4966-9003-4b5a7d773256 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:15.849210 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f1f03236-302b-473a-b161-9efc541d8a98 req-b6231e70-23a8-4966-9003-4b5a7d773256 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 943 time: 0.0485375 Nov 15 17:50:15.887875 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-feda99d6-94de-45ed-8902-c0f263f39f79 req-4be8f958-664b-4afd-8dea-b67cec831506 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857658 Nov 15 17:50:15.900198 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f1f03236-302b-473a-b161-9efc541d8a98 req-d6a925fd-b45b-41bb-8a57-68a7c660b175 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454586 Nov 15 17:50:16.320789 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c742091c-5ad8-49e8-b633-54ed6dfb354b details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:50:16.420308 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:16.431134 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'c742091c-5ad8-49e8-b633-54ed6dfb354b', 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b', 'port_id': 'c742091c-5ad8-49e8-b633-54ed6dfb354b', 'mac_address': 'fa:16:3e:f6:c3:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 446, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7424951c-80da-4659-9a6c-ca7b2ec6e17a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:50:16.467507 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:16.480192 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c742091c-5ad8-49e8-b633-54ed6dfb354b {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:16.504825 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:16.510225 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:16.562040 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:16.610553 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bac382-228e-4fe1-8141-6a60bf6f4e8f req-0dca281a-5034-4bfb-901d-d1d5afb792f0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:16.612076 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-84bac382-228e-4fe1-8141-6a60bf6f4e8f req-0dca281a-5034-4bfb-901d-d1d5afb792f0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0499723 Nov 15 17:50:16.663245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-84bac382-228e-4fe1-8141-6a60bf6f4e8f req-f73d1dee-c32a-4d3b-b879-fef3279dfcd9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449078 Nov 15 17:50:16.860024 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['c742091c-5ad8-49e8-b633-54ed6dfb354b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:17.025124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0693b5-f08b-405d-9e2c-e05b65608b1c req-5d6abd19-eebf-4662-9998-7f89d6ec5323 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:17.026657 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f0693b5-f08b-405d-9e2c-e05b65608b1c req-5d6abd19-eebf-4662-9998-7f89d6ec5323 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 944 time: 0.0532055 Nov 15 17:50:17.072675 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f0693b5-f08b-405d-9e2c-e05b65608b1c req-9a945733-b0b4-4a04-af7d-d667756e7e63 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400050 Nov 15 17:50:17.784082 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b930e3-af48-40a0-a1ef-5daf2d0ce2a1 req-38aa05bc-f929-4883-8353-9f50922f6d7b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:17.785541 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-67b930e3-af48-40a0-a1ef-5daf2d0ce2a1 req-38aa05bc-f929-4883-8353-9f50922f6d7b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0557232 Nov 15 17:50:17.834989 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-67b930e3-af48-40a0-a1ef-5daf2d0ce2a1 req-30f9b2df-a4a2-48be-824f-43022c955ef1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410802 Nov 15 17:50:18.190126 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef64e682-6ba4-4be8-adc8-33bcf302fbf7 req-e4192b8f-61d0-4a16-a33f-bc44d4086405 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:18.191516 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ef64e682-6ba4-4be8-adc8-33bcf302fbf7 req-e4192b8f-61d0-4a16-a33f-bc44d4086405 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 944 time: 0.0498996 Nov 15 17:50:18.239191 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ef64e682-6ba4-4be8-adc8-33bcf302fbf7 req-b1c5d1be-edf0-43bd-ade7-44447c24d9b5 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416193 Nov 15 17:50:18.338338 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c742091c-5ad8-49e8-b633-54ed6dfb354b up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:50:18.393670 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port c742091c-5ad8-49e8-b633-54ed6dfb354b completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:50:18.397588 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port c742091c-5ad8-49e8-b633-54ed6dfb354b triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:50:18.397959 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:18.588458 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:18.611039 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:18.613362 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-519d6785-2a01-4958-926a-d299811493d6" -d '{"events": [{"server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "name": "network-vif-plugged", "status": "completed", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:18.632061 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:18.637032 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:18.660292 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e40678c-a44f-4cb9-a626-0d4cfd5c1610 x-openstack-request-id: req-2e40678c-a44f-4cb9-a626-0d4cfd5c1610 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:18.660608 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "name": "network-vif-plugged", "status": "completed", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:18.660865 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-2e40678c-a44f-4cb9-a626-0d4cfd5c1610 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:18.661254 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b', 'code': 200} Nov 15 17:50:18.686543 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:18.846843 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65520874-35a7-4a37-8e38-98fafca0095b req-a31d4353-782e-4374-9463-b7190fb02c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:18.848266 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65520874-35a7-4a37-8e38-98fafca0095b req-a31d4353-782e-4374-9463-b7190fb02c21 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 1098 time: 0.0406444 Nov 15 17:50:18.894080 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-65520874-35a7-4a37-8e38-98fafca0095b req-0bf60272-0682-4ee8-ad72-f3506d76e715 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380025 Nov 15 17:50:18.951050 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa2aaef-d55d-484f-8b66-c9ba5e027eda req-cee093b1-da3f-4770-a3f1-33940171823f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:18.952540 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aaa2aaef-d55d-484f-8b66-c9ba5e027eda req-cee093b1-da3f-4770-a3f1-33940171823f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0468230 Nov 15 17:50:19.004879 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aaa2aaef-d55d-484f-8b66-c9ba5e027eda req-3d254073-a593-4f2a-a7f5-21d67f92a0e3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438411 Nov 15 17:50:19.367632 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03bc2f8-6849-47f0-be24-9e1ac6e646a6 req-b3895156-e0f8-49e0-9aa9-b3b2e23768fa tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:19.369458 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b03bc2f8-6849-47f0-be24-9e1ac6e646a6 req-b3895156-e0f8-49e0-9aa9-b3b2e23768fa tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0519135 Nov 15 17:50:19.417842 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b03bc2f8-6849-47f0-be24-9e1ac6e646a6 req-0290189b-6f01-416c-a588-7d0b3ef6b9cb tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420682 Nov 15 17:50:20.536795 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f2a8a0-06f6-4195-85ba-7a40490a1d28 req-e347cb7a-7259-4ea5-8719-af84b1d02988 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:20.540033 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75f2a8a0-06f6-4195-85ba-7a40490a1d28 req-e347cb7a-7259-4ea5-8719-af84b1d02988 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0521967 Nov 15 17:50:20.591263 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75f2a8a0-06f6-4195-85ba-7a40490a1d28 req-9fe608b3-07b5-41ae-bb9f-7e0c8bdc9e48 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438049 Nov 15 17:50:20.600063 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-35833ba3-517f-4311-a2a5-018e2ab03548 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381827 Nov 15 17:50:20.694872 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-d3def811-9dab-4906-a15d-fabbfeaa7f43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:20.696385 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-d3def811-9dab-4906-a15d-fabbfeaa7f43 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 1098 time: 0.0394933 Nov 15 17:50:20.810478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-cae01b22-62d7-4d68-9d8a-68846d72cc00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:20.811998 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-cae01b22-62d7-4d68-9d8a-68846d72cc00 service neutron] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 916 time: 0.0892136 Nov 15 17:50:20.857268 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-11afcc36-5b53-4912-a5ff-9522f130916d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6eb8cabb-711a-47ac-965c-82db4534f237 HTTP/1.1" status: 200 len: 217 time: 0.0350981 Nov 15 17:50:20.911590 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-348685a5-bf82-4cea-8200-21c8878ba272 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:20.913034 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-348685a5-bf82-4cea-8200-21c8878ba272 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0480118 Nov 15 17:50:20.949326 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-5018255d-f24f-48fc-b8ed-662ae1542cd6 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244396 Nov 15 17:50:21.043400 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-034f371c-d777-4025-9e2f-ca9ef0ef7ac6 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790987 Nov 15 17:50:21.142740 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-44f6282a-10eb-4e10-b3ef-7bb43948eafc req-5d812552-0469-4b51-a562-784fa0a556d1 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898798 Nov 15 17:50:22.310740 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:30.105571 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bbeb36-60b0-4bfe-b9f2-ad058c0f6ebc req-0a351750-f1ef-4e39-bc3b-71c4d7916d61 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:30.107178 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51bbeb36-60b0-4bfe-b9f2-ad058c0f6ebc req-0a351750-f1ef-4e39-bc3b-71c4d7916d61 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0527294 Nov 15 17:50:30.153563 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51bbeb36-60b0-4bfe-b9f2-ad058c0f6ebc req-da24d363-69c3-46cf-a6bc-92a019805fa6 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404298 Nov 15 17:50:30.778151 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bd191238-4ba5-4d58-b597-20519a0c2e07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:30.959635 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5098e1aa-13ab-446f-8c10-cb6aecee19f5 req-158b5e77-b436-4419-9dd6-8f75193a6930 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:30.961486 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5098e1aa-13ab-446f-8c10-cb6aecee19f5 req-158b5e77-b436-4419-9dd6-8f75193a6930 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0491071 Nov 15 17:50:31.011147 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5098e1aa-13ab-446f-8c10-cb6aecee19f5 req-dce75a22-00b4-475a-bd2e-318443ec4e53 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437741 Nov 15 17:50:31.073266 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a9fd24-6836-41dd-9ba3-645a5d42be10 req-7a9ff50c-03ad-40c9-9d41-9c20431b9ebe tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:31.075329 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0a9fd24-6836-41dd-9ba3-645a5d42be10 req-7a9ff50c-03ad-40c9-9d41-9c20431b9ebe tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0526259 Nov 15 17:50:31.127387 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0a9fd24-6836-41dd-9ba3-645a5d42be10 req-37b0faf4-00bd-4890-906e-1780a5c569e5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443168 Nov 15 17:50:31.290826 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dab918-b8ce-437a-8b3d-15d72f447148 req-78dd4a3c-91f3-4890-82cb-cb7daa907ea3 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:31.292780 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9dab918-b8ce-437a-8b3d-15d72f447148 req-78dd4a3c-91f3-4890-82cb-cb7daa907ea3 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0517943 Nov 15 17:50:31.345465 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9dab918-b8ce-437a-8b3d-15d72f447148 req-7e85ea71-925d-4d18-ae3b-175f291a055c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460682 Nov 15 17:50:32.256054 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2070819-51c1-4ba9-9b69-f84764182f34 req-4461ec61-e986-4296-989d-ad8f7f007920 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:32.257588 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2070819-51c1-4ba9-9b69-f84764182f34 req-4461ec61-e986-4296-989d-ad8f7f007920 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0543301 Nov 15 17:50:32.309403 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2070819-51c1-4ba9-9b69-f84764182f34 req-ee22754c-3e7f-481b-9424-50ca6487a044 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459163 Nov 15 17:50:32.461123 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-4b3f9e4f-9250-4d57-8d74-8b64ca401101 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:32.462285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4f33e1-1eeb-4735-ab6d-c131e594a68c req-e5bb5f39-45b7-4ec5-ae2c-1556c0fb0764 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:32.462559 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-4b3f9e4f-9250-4d57-8d74-8b64ca401101 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0575838 Nov 15 17:50:32.463750 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b4f33e1-1eeb-4735-ab6d-c131e594a68c req-e5bb5f39-45b7-4ec5-ae2c-1556c0fb0764 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=dd1210ce-2546-422e-b533-44c48249570c HTTP/1.1" status: 200 len: 945 time: 0.0489044 Nov 15 17:50:32.512095 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b4f33e1-1eeb-4735-ab6d-c131e594a68c req-7c2c1c8a-e6ab-4031-93b6-69aa4be6613d tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418437 Nov 15 17:50:32.561248 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Deleting port c742091c-5ad8-49e8-b633-54ed6dfb354b {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:50:32.561569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:32.656125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] For port c742091c-5ad8-49e8-b633-54ed6dfb354b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c742091c-5ad8-49e8-b633-54ed6dfb354b,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:32.656484 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:32.669838 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Calling delete_port for c742091c-5ad8-49e8-b633-54ed6dfb354b owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:50:32.804455 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:32.818009 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['c742091c-5ad8-49e8-b633-54ed6dfb354b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:32.832076 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Pushing event deleted for resources: {'Port': ['ID=c742091c-5ad8-49e8-b633-54ed6dfb354b,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:32.841059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.841394 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.841716 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.842053 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.842969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.842969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.843492 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.843753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.843909 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.844212 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.844529 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.845521 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:32.885948 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] No DVR routers for this DVR port c742091c-5ad8-49e8-b633-54ed6dfb354b on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:50:32.889178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:32.892549 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-23d00b2a-ba03-4d14-b45d-dd529ab52a81 req-181c8447-686f-4cbb-a237-82abab222e6f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "DELETE /v2.0/ports/c742091c-5ad8-49e8-b633-54ed6dfb354b HTTP/1.1" status: 204 len: 173 time: 0.4221075 Nov 15 17:50:32.892990 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'name': 'network-vif-deleted', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:32.895227 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d1477b9-b13a-4c0d-a4b7-a0077b8c5b03" -d '{"events": [{"server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "name": "network-vif-deleted", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:32.938647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b55c6968-40f7-46ef-b2ba-8098a85f96d9 x-openstack-request-id: req-b55c6968-40f7-46ef-b2ba-8098a85f96d9 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:32.938913 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dd1210ce-2546-422e-b533-44c48249570c", "name": "network-vif-deleted", "tag": "c742091c-5ad8-49e8-b633-54ed6dfb354b", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:32.939310 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b55c6968-40f7-46ef-b2ba-8098a85f96d9 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:32.939788 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd1210ce-2546-422e-b533-44c48249570c', 'name': 'network-vif-deleted', 'tag': 'c742091c-5ad8-49e8-b633-54ed6dfb354b', 'status': 'completed', 'code': 200} Nov 15 17:50:33.074377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-acb3fb85-d23a-438b-a63b-9ccc2f8da563 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:33.435053 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a8da66-6802-4bb3-bf20-d4757345f960 req-9d519be0-70b9-4d4e-a735-06e5e6dee09d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:33.437046 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-31a8da66-6802-4bb3-bf20-d4757345f960 req-9d519be0-70b9-4d4e-a735-06e5e6dee09d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0529485 Nov 15 17:50:33.491286 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-31a8da66-6802-4bb3-bf20-d4757345f960 req-ed7cdb56-e34c-47d6-8d5c-849abdca6f24 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476573 Nov 15 17:50:33.816804 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-bc3e772f-f7e0-45fe-90dc-4c28e088c496 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:33.818429 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-bc3e772f-f7e0-45fe-90dc-4c28e088c496 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 808 time: 0.1026523 Nov 15 17:50:33.836280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-2be12e19-272a-4f97-a437-ebc1c731eec5 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/quotas/4f592f6fa5d14c7b91a773d7f8a2f295 HTTP/1.1" status: 200 len: 375 time: 0.0095425 Nov 15 17:50:33.868040 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-f2634d15-4a49-44f2-88b3-9a461e39faf7 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0262856 Nov 15 17:50:33.964989 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-7d1cb6d8-8783-4b7b-b3ba-c386817ae153 service neutron] 10.222.0.31 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890584 Nov 15 17:50:34.058598 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-464f45a3-2200-430c-a22c-e790c9211fb1 service neutron] 10.222.0.31 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868800 Nov 15 17:50:34.233617 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9fbbffd9-1ebd-42ff-96bb-88055729497f req-80137dea-97d5-40b2-be01-aa22766a506f tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 210 time: 0.0300901 Nov 15 17:50:34.455055 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:34.610572 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d4bb9f4-b79d-4f1e-a56c-93c6535981b2 req-5a159b3f-9200-4df7-8114-7b5a548a2cb4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:34.611985 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4d4bb9f4-b79d-4f1e-a56c-93c6535981b2 req-5a159b3f-9200-4df7-8114-7b5a548a2cb4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0502350 Nov 15 17:50:34.664278 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4d4bb9f4-b79d-4f1e-a56c-93c6535981b2 req-3db49a50-556a-4bc8-ad8c-a98418dcc9c4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461197 Nov 15 17:50:35.048198 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:50:35.317796 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-c847ffa9-302b-4b66-8cd5-120132374221 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:35.319357 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-c847ffa9-302b-4b66-8cd5-120132374221 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 808 time: 0.1106954 Nov 15 17:50:35.338676 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Request body: {'port': {'device_id': '778a6f3d-6162-43ef-9e49-07df35c07303', 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b', 'admin_state_up': True, 'tenant_id': '4f592f6fa5d14c7b91a773d7f8a2f295'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:35.385182 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-16279d4d-3ebf-4ffc-bdab-1de2cef80113 req-2a123c23-ca97-4af2-a16c-c00ee90e0d4e tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 210 time: 0.0365510 Nov 15 17:50:35.425507 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55938) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:35.464804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Made reservation on behalf of 4f592f6fa5d14c7b91a773d7f8a2f295 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:50:35.468339 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.542453 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.563728 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.607023 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Allocated IP 172.20.0.9 (840a23aa-77b8-4f10-9b9f-7b064a15ef6b/7424951c-80da-4659-9a6c-ca7b2ec6e17a/237c8e48-cb73-47e3-898c-9a923e7b48c3) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:50:35.626608 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.630045 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.668858 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f87d65ba-dd50-432e-8e1f-1b4926049fb7,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:35.676692 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=3f7f46c388654bbfb1e12122fd0bfdd8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2498970 Nov 15 17:50:35.678327 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.678659 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.678985 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.679306 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.679619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.679961 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.680279 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.680593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.680950 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.681244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.681557 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.681886 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88de3489-844e-4165-99cb-a1dabc9993d8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:35.685152 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 55948) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:50:35.732030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.755838 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.778562 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.790999 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.822030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0775f64c-8264-42f0-b515-ccdf562bf789 req-e87d6777-25f6-4bec-83b2-651caa0082ab tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:35.823557 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0775f64c-8264-42f0-b515-ccdf562bf789 req-e87d6777-25f6-4bec-83b2-651caa0082ab tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0811450 Nov 15 17:50:35.835272 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:50:35.840915 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:50:35.845102 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:50:35.864094 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.866623 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.870619 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f87d65ba-dd50-432e-8e1f-1b4926049fb7 HTTP/1.1" status: 204 len: 168 time: 0.1820247 Nov 15 17:50:35.872212 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Pushing event updated for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:35.884098 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ced1a3-2126-45e3-8b20-b0ccfa71ce42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f87d65ba-dd50-432e-8e1f-1b4926049fb7,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:35.896565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0775f64c-8264-42f0-b515-ccdf562bf789 req-c02a9ddd-f2e4-4857-a99a-bb607ac90c45 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0589015 Nov 15 17:50:35.904535 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:35.905334 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:35.929401 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-04cd5712-6cae-4e6f-8392-4cfd0a417b0c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5947187 Nov 15 17:50:35.948245 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Request body: {'port': {'device_id': '778a6f3d-6162-43ef-9e49-07df35c07303', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:36.006570 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.287054 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 237c8e48-cb73-47e3-898c-9a923e7b48c3 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:36.294269 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.306253 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Transition to ACTIVE for port object 237c8e48-cb73-47e3-898c-9a923e7b48c3 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:50:36.310725 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.381929 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Pushing event updated for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:36.425234 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c742091c-5ad8-49e8-b633-54ed6dfb354b no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:50:36.434706 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Attempting to bind port 237c8e48-cb73-47e3-898c-9a923e7b48c3 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:50:36.435031 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Attempting to bind port 237c8e48-cb73-47e3-898c-9a923e7b48c3 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:50:36.444569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Attempting to bind port 237c8e48-cb73-47e3-898c-9a923e7b48c3 on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:36.450896 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Port 237c8e48-cb73-47e3-898c-9a923e7b48c3 on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:50:36.451429 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Attempting to bind port 237c8e48-cb73-47e3-898c-9a923e7b48c3 on network 840a23aa-77b8-4f10-9b9f-7b064a15ef6b {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:36.457468 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 50, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:50:36.458063 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Checking segment: {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:50:36.459125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Bound using segment: {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:50:36.459764 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Bound port: 237c8e48-cb73-47e3-898c-9a923e7b48c3, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87006e21-df9a-4769-925c-1d4d72189624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:50:36.460375 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.486634 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: c742091c-5ad8-49e8-b633-54ed6dfb354b {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:50:36.487096 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c742091c-5ad8-49e8-b633-54ed6dfb354b not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:50:36.551609 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:50:36.555140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:50:36.565580 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.592338 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd350bc9-8883-4976-a008-80d1d71b9a4d req-34b24faf-ce42-43d4-b840-c3d3b9e60b22 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:36.600533 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fd350bc9-8883-4976-a008-80d1d71b9a4d req-34b24faf-ce42-43d4-b840-c3d3b9e60b22 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 943 time: 0.0753942 Nov 15 17:50:36.629057 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:36.630028 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.631789 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] 10.222.0.48 "PUT /v2.0/ports/237c8e48-cb73-47e3-898c-9a923e7b48c3 HTTP/1.1" status: 200 len: 1093 time: 0.6878085 Nov 15 17:50:36.632222 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:36.635914 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-942a53fd-4424-4e7f-904f-1af2de2f2e33" -d '{"events": [{"name": "network-changed", "server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:36.673708 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:36.722012 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fd350bc9-8883-4976-a008-80d1d71b9a4d req-670ee1bb-7ebb-475d-b2e7-ee123a4cbbb6 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1155226 Nov 15 17:50:36.735567 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a0420a0-12d1-484b-a37a-faf70bf8b328 x-openstack-request-id: req-0a0420a0-12d1-484b-a37a-faf70bf8b328 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:36.736047 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:36.736414 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-0a0420a0-12d1-484b-a37a-faf70bf8b328 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:36.736797 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3', 'status': 'completed', 'code': 200} Nov 15 17:50:36.757472 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13de8463-b12c-41fc-b081-6da8e73877ef service neutron] Pushing event updated for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:36.774345 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-aab66357-973f-44cd-9d76-c74ebe420a60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:36.776152 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-aab66357-973f-44cd-9d76-c74ebe420a60 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 1096 time: 0.0599794 Nov 15 17:50:36.826066 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-4f396206-96fc-41d4-92df-bd25cd7a1081 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3 HTTP/1.1" status: 200 len: 217 time: 0.0391097 Nov 15 17:50:36.880400 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-e5e9d2c8-0a93-4656-85a1-b4b9cd6fb45b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:36.881891 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-e5e9d2c8-0a93-4656-85a1-b4b9cd6fb45b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=7424951c-80da-4659-9a6c-ca7b2ec6e17a HTTP/1.1" status: 200 len: 848 time: 0.0449891 Nov 15 17:50:36.928693 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-f5b1d59b-4e2d-4949-acde-a0a334a013e6 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0328791 Nov 15 17:50:36.943241 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-d1ecd6b3-7584-4c3c-997c-c24183ba7455 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:36.950304 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-d1ecd6b3-7584-4c3c-997c-c24183ba7455 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.1174445 Nov 15 17:50:36.964250 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-2342fb03-84ca-47e1-8351-cb9c1cd1e712 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/quotas/cdb494aa542c4eff8e62f9dd653bde82 HTTP/1.1" status: 200 len: 375 time: 0.0130441 Nov 15 17:50:37.047122 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-5779ac62-9856-439e-87be-d2a89783d2c0 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0760818 Nov 15 17:50:37.056109 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-2751fded-6b35-40be-977a-9d147a0ea80a service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1137407 Nov 15 17:50:37.057725 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8e9e78-db0b-41bc-890a-fbccf05be457 req-256f61bf-bc94-4be9-b0ee-6f1b1aa76168 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:37.059114 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f8e9e78-db0b-41bc-890a-fbccf05be457 req-256f61bf-bc94-4be9-b0ee-6f1b1aa76168 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0894597 Nov 15 17:50:37.172685 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-adbdb47e-f100-4a6e-9291-9bb139f49c0a req-26b40eab-5ea4-45ea-bb24-5ba7cadd04b7 service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1029861 Nov 15 17:50:37.173174 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f8e9e78-db0b-41bc-890a-fbccf05be457 req-4458901d-f8d2-4652-bcaf-fe096bd7ba66 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1051116 Nov 15 17:50:37.189335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-006ba32a-9ba3-437d-bdf0-21a9f933255e service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292660 Nov 15 17:50:37.284198 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-d8af2c64-89cd-4036-9fd7-a78dbadf4d1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:37.285723 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-d8af2c64-89cd-4036-9fd7-a78dbadf4d1f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 1096 time: 0.0424719 Nov 15 17:50:37.294570 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-b92aed73-f063-4dc2-b3b2-8bb1a188453c service neutron] 10.222.0.31 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939288 Nov 15 17:50:37.382650 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-d96b30c7-28fd-4ea6-970a-c33694cf8885 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:37.384168 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-d96b30c7-28fd-4ea6-970a-c33694cf8885 service neutron] 10.222.0.48 "GET /v2.0/networks?id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 200 len: 909 time: 0.0897813 Nov 15 17:50:37.436631 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-93db093b-8f96-4e07-9b50-12b4fb36d662 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3 HTTP/1.1" status: 200 len: 217 time: 0.0366457 Nov 15 17:50:37.472315 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2228cfd6-f0a5-4165-90b0-ca76ea0f5687 req-6b3e124e-6236-4559-bb6e-56fd8864d8fe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 210 time: 0.0289431 Nov 15 17:50:37.500536 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-f4e64fe2-6213-4813-8791-77d88b919cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:37.502008 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-f4e64fe2-6213-4813-8791-77d88b919cc6 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=7424951c-80da-4659-9a6c-ca7b2ec6e17a HTTP/1.1" status: 200 len: 848 time: 0.0534616 Nov 15 17:50:37.535270 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-3f62004f-3a9c-444d-a986-6e7878f8a031 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=840a23aa-77b8-4f10-9b9f-7b064a15ef6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0243232 Nov 15 17:50:37.642889 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-984f0c88-2e16-4314-8a1e-8cb7a0201a19 service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908177 Nov 15 17:50:37.750524 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-942a53fd-4424-4e7f-904f-1af2de2f2e33 req-ba8079c2-6c75-45e4-9e5e-4b65ad9b20b5 service neutron] 10.222.0.48 "GET /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944602 Nov 15 17:50:37.840741 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46690f6-4cf9-4e6f-b104-f0f8f8be2019 req-4fb6d166-710a-4b48-bc7a-3e287aedd0b5 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:37.842542 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b46690f6-4cf9-4e6f-b104-f0f8f8be2019 req-4fb6d166-710a-4b48-bc7a-3e287aedd0b5 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 943 time: 0.0527115 Nov 15 17:50:37.892603 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b46690f6-4cf9-4e6f-b104-f0f8f8be2019 req-b6ddec25-a31a-43b9-b924-6eeff2d5ba3d tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435722 Nov 15 17:50:38.293153 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264c506e-254f-4563-88b7-4e810fdf1f8c req-acecd01d-b605-4f46-817b-ec834e5b5f92 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:38.294684 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-264c506e-254f-4563-88b7-4e810fdf1f8c req-acecd01d-b605-4f46-817b-ec834e5b5f92 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0509927 Nov 15 17:50:38.343027 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-264c506e-254f-4563-88b7-4e810fdf1f8c req-befa73e3-05b0-4761-86aa-235720e5c9af tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414340 Nov 15 17:50:38.449753 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 237c8e48-cb73-47e3-898c-9a923e7b48c3 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:50:38.557560 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:38.570522 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '237c8e48-cb73-47e3-898c-9a923e7b48c3', 'network_id': '840a23aa-77b8-4f10-9b9f-7b064a15ef6b', 'port_id': '237c8e48-cb73-47e3-898c-9a923e7b48c3', 'mac_address': 'fa:16:3e:bb:65:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 446, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7424951c-80da-4659-9a6c-ca7b2ec6e17a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:50:38.592572 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-22a52803-2dbb-4e46-8eaf-e7287ce34bf8 req-2241a874-c00d-488b-9319-45fc73baaa73 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 210 time: 0.0342309 Nov 15 17:50:38.633461 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:38.656839 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 237c8e48-cb73-47e3-898c-9a923e7b48c3 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:38.706107 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:38.712894 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-1cf10f2c-cf8a-4950-a143-b1759c982f26 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:38.714884 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-1cf10f2c-cf8a-4950-a143-b1759c982f26 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 815 time: 0.1697521 Nov 15 17:50:38.716240 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:38.736188 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Request body: {'port': {'device_id': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'admin_state_up': True, 'tenant_id': 'cdb494aa542c4eff8e62f9dd653bde82'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:38.773294 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:38.781917 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.784124 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.784481 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.784818 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.785152 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.785483 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.785803 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.786130 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.786503 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.786839 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.787212 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.787452 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:50:38.852240 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Made reservation on behalf of cdb494aa542c4eff8e62f9dd653bde82 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:50:38.855807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:38.984000 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Allocated IP 172.20.0.5 (3919dfc4-3e42-4144-97e7-2ccb5146f2a2/c6a2eeae-0fac-4586-be17-093ae2e28ec5/3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:50:39.018190 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0a0aae-1f87-4dd3-892a-3d7b366db90e req-2cebb11a-d890-4ceb-98e6-d8ce088cab47 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:39.019893 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f0a0aae-1f87-4dd3-892a-3d7b366db90e req-2cebb11a-d890-4ceb-98e6-d8ce088cab47 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 944 time: 0.0523858 Nov 15 17:50:39.069831 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f0a0aae-1f87-4dd3-892a-3d7b366db90e req-7fb1beb5-b8aa-4356-9bfc-ab0f44d03b5c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438635 Nov 15 17:50:39.134207 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.135069 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['237c8e48-cb73-47e3-898c-9a923e7b48c3'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:39.171628 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.214608 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:50:39.218015 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:50:39.222128 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:50:39.228470 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event updated for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:39.274147 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:39.274751 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.291895 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-48cb25ee-da5e-4347-b677-29e3edf003ac tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5608954 Nov 15 17:50:39.305856 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Request body: {'port': {'device_id': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:50:39.360112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.467522 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0d77f9-4d7d-4efb-ae5b-dc3832e66f9a req-e3b1170a-9cb8-4b2c-ab91-014cf47bc128 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:39.469388 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6a0d77f9-4d7d-4efb-ae5b-dc3832e66f9a req-e3b1170a-9cb8-4b2c-ab91-014cf47bc128 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0530133 Nov 15 17:50:39.538846 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6a0d77f9-4d7d-4efb-ae5b-dc3832e66f9a req-9a0a79a0-c6c0-4c34-8bee-5a5461728a13 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514660 Nov 15 17:50:39.712703 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274c9375-a6e4-4f74-be7b-ad42f1c27087 req-91bffd95-5cf2-43d0-96fb-69ac95cb05cd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:39.714177 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-274c9375-a6e4-4f74-be7b-ad42f1c27087 req-91bffd95-5cf2-43d0-96fb-69ac95cb05cd tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 931 time: 0.0483904 Nov 15 17:50:39.774559 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-274c9375-a6e4-4f74-be7b-ad42f1c27087 req-89c21ed7-a8d0-4842-9c47-a0153eac99c2 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513206 Nov 15 17:50:39.844146 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:39.852151 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.864854 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Transition to ACTIVE for port object 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:50:39.870620 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:39.920128 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Pushing event updated for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:39.988855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Attempting to bind port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:50:39.989098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Attempting to bind port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:50:39.989419 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Attempting to bind port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:39.993852 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:50:39.994165 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Attempting to bind port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 on network 3919dfc4-3e42-4144-97e7-2ccb5146f2a2 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:50:39.999330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 50, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:50:39.999795 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Checking segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:50:40.000221 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Bound using segment: {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:50:40.000649 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Bound port: 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 431, 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:50:40.000996 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.041688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237', '51f77003-54ff-44ef-a4c0-98da6c460703', '6ccdae31-65e3-4a19-b710-4eca9f518175'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:40.064096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:50:40.067259 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:50:40.073591 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.110813 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.111604 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.113265 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] 10.222.0.48 "PUT /v2.0/ports/3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 HTTP/1.1" status: 200 len: 1093 time: 0.8114126 Nov 15 17:50:40.116475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:40.127852 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4" -d '{"events": [{"name": "network-changed", "server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:40.158792 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8624a081-6415-42d8-aaf7-d558e400abcb service neutron] Pushing event updated for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:40.220317 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-13916059-8f2e-4a28-8046-34b97a0deadc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.221835 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-13916059-8f2e-4a28-8046-34b97a0deadc service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 1096 time: 0.0570021 Nov 15 17:50:40.223428 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f63cb35-78a2-4378-bf29-8047ca0d672d x-openstack-request-id: req-8f63cb35-78a2-4378-bf29-8047ca0d672d {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:40.223731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:40.223988 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-8f63cb35-78a2-4378-bf29-8047ca0d672d {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:40.224364 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881', 'status': 'completed', 'code': 200} Nov 15 17:50:40.243854 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28fd603-4f97-4866-b835-19cab59d44b4 req-74b18b83-622f-42f1-b0b2-b4ea345b20ff tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.245527 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b28fd603-4f97-4866-b835-19cab59d44b4 req-74b18b83-622f-42f1-b0b2-b4ea345b20ff tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 944 time: 0.0619245 Nov 15 17:50:40.277313 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-0c742394-c977-472a-80c7-996269d322d4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 HTTP/1.1" status: 200 len: 217 time: 0.0362191 Nov 15 17:50:40.295670 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b28fd603-4f97-4866-b835-19cab59d44b4 req-df4d51ad-4cbc-4bd0-8542-b5718cd3bb80 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416746 Nov 15 17:50:40.337745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a28601-accc-44e9-825e-83c6179cc142 req-e7ab0a98-b24f-43ba-a359-dbf6a00da9cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.339287 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-e7ab0a98-b24f-43ba-a359-dbf6a00da9cf service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0492508 Nov 15 17:50:40.373057 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-e9fbb8d8-1be0-4e96-a579-4ec4e4680563 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239873 Nov 15 17:50:40.456845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 237c8e48-cb73-47e3-898c-9a923e7b48c3 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:50:40.487851 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-d383f49d-e545-4024-a1d8-aab2400c2dcd service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1005175 Nov 15 17:50:40.510104 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 237c8e48-cb73-47e3-898c-9a923e7b48c3 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:50:40.513925 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 237c8e48-cb73-47e3-898c-9a923e7b48c3 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:50:40.514426 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.590366 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-73a28601-accc-44e9-825e-83c6179cc142 req-df1b7914-e085-4c54-92ad-ba52ae4cffbd service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896459 Nov 15 17:50:40.595853 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.624916 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:40.627230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7b75dca-f35e-49ca-a826-b80f10575f1d" -d '{"events": [{"server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "name": "network-vif-plugged", "status": "completed", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:40.640319 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:40.645249 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:40.659787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0aec1ec-7b63-473a-8165-d6e48de9b6d3 req-f0a6245f-4407-4127-a1cc-08f241be3664 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.661318 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0aec1ec-7b63-473a-8165-d6e48de9b6d3 req-f0a6245f-4407-4127-a1cc-08f241be3664 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0538814 Nov 15 17:50:40.692992 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:40.716837 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0aec1ec-7b63-473a-8165-d6e48de9b6d3 req-3aafc739-eef0-4728-b6d9-d6cfdca2986c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426295 Nov 15 17:50:40.730431 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-c68fd834-c366-412e-8a09-b9e570896ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.732285 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-c68fd834-c366-412e-8a09-b9e570896ac7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 1096 time: 0.0455344 Nov 15 17:50:40.760419 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02d2a43e-bab5-4394-9d89-59f609f3c5ba x-openstack-request-id: req-02d2a43e-bab5-4394-9d89-59f609f3c5ba {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:40.760635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "name": "network-vif-plugged", "status": "completed", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:40.760886 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-02d2a43e-bab5-4394-9d89-59f609f3c5ba {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:40.761275 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3', 'code': 200} Nov 15 17:50:40.832045 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-c2715ecb-b1c4-4980-a4ed-4b8ef480c851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.834147 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-c2715ecb-b1c4-4980-a4ed-4b8ef480c851 service neutron] 10.222.0.48 "GET /v2.0/networks?id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 200 len: 916 time: 0.0927763 Nov 15 17:50:40.885971 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-7f8638df-4c31-438e-bb8d-cf841726a31c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 HTTP/1.1" status: 200 len: 217 time: 0.0400169 Nov 15 17:50:40.897594 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f227dc2-9f3b-423b-a3ac-213912713c10 req-9c961eab-44ab-4eaf-9ad2-1faa42185f53 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.899054 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9f227dc2-9f3b-423b-a3ac-213912713c10 req-9c961eab-44ab-4eaf-9ad2-1faa42185f53 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 943 time: 0.0524852 Nov 15 17:50:40.956130 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9f227dc2-9f3b-423b-a3ac-213912713c10 req-8bcf3c0f-59eb-4afc-ab4a-624199d439ad tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464528 Nov 15 17:50:40.969211 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-efa65109-bd5f-44a8-ac94-6eb313be9605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.970649 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-efa65109-bd5f-44a8-ac94-6eb313be9605 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 200 len: 855 time: 0.0755942 Nov 15 17:50:40.987161 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cbd7f7-4953-4431-8779-9e9b54969369 req-3706730c-1639-46bb-9e5a-ad19326e7263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:40.988668 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-74cbd7f7-4953-4431-8779-9e9b54969369 req-3706730c-1639-46bb-9e5a-ad19326e7263 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 1098 time: 0.0679634 Nov 15 17:50:41.007835 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-d256e211-4095-4e7c-a264-3c0c82efef46 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=3919dfc4-3e42-4144-97e7-2ccb5146f2a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0293176 Nov 15 17:50:41.102368 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-74cbd7f7-4953-4431-8779-9e9b54969369 req-17dbf09a-9d22-4646-875b-7ccb85d97af1 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968716 Nov 15 17:50:41.136806 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-d7e5cdb6-d630-4aee-b18a-843f6f331ab8 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1162312 Nov 15 17:50:41.415817 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5b197e-1124-434c-ae0c-9f12c9e19f77 req-47e24a49-ad30-4118-a971-ee4a92efaa03 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:41.417537 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7a5b197e-1124-434c-ae0c-9f12c9e19f77 req-47e24a49-ad30-4118-a971-ee4a92efaa03 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0507996 Nov 15 17:50:41.442264 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8f20bff9-b182-471c-b7e0-8c93c2ab7ce4 req-bdb026e3-22d8-4054-8b52-c34b78200582 service neutron] 10.222.0.48 "GET /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0915852 Nov 15 17:50:41.468311 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7a5b197e-1124-434c-ae0c-9f12c9e19f77 req-e5206195-3798-433c-acd8-27ec4a03bfc9 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434604 Nov 15 17:50:41.850173 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ad501b0-d910-4887-a904-14d1c21bf3fb req-f9a69df4-946e-48b6-ae6f-c58563c47caf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:41.851735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1ad501b0-d910-4887-a904-14d1c21bf3fb req-f9a69df4-946e-48b6-ae6f-c58563c47caf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0626452 Nov 15 17:50:41.898512 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1ad501b0-d910-4887-a904-14d1c21bf3fb req-81e230b7-5e7b-4d07-a54e-ebf741b34d7c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407727 Nov 15 17:50:42.076538 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc40f4d4-d739-4c82-a8c4-604385539fc3 req-6abc02df-61c3-462f-842b-7ee37c884820 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:42.078534 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cc40f4d4-d739-4c82-a8c4-604385539fc3 req-6abc02df-61c3-462f-842b-7ee37c884820 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 943 time: 0.0522182 Nov 15 17:50:42.126376 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cc40f4d4-d739-4c82-a8c4-604385539fc3 req-6284c6f7-eb8b-4c72-866a-78e2ff88f28f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420146 Nov 15 17:50:42.460290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:50:42.567468 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:42.580387 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881', 'network_id': '3919dfc4-3e42-4144-97e7-2ccb5146f2a2', 'port_id': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881', 'mac_address': 'fa:16:3e:2d:d6:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 431, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6a2eeae-0fac-4586-be17-093ae2e28ec5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:50:42.590894 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e856a3-af1a-4536-8a64-34c532899838 req-f6b09ba5-30c9-4c9a-9dd0-1d8f5e267aee tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:42.592925 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e1e856a3-af1a-4536-8a64-34c532899838 req-f6b09ba5-30c9-4c9a-9dd0-1d8f5e267aee tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0494230 Nov 15 17:50:42.620411 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:42.636525 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:50:42.649004 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e1e856a3-af1a-4536-8a64-34c532899838 req-f7c34eb2-c88c-476f-a569-488c260a7e12 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483031 Nov 15 17:50:42.661907 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:42.665976 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:42.722736 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:43.014545 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd4b915-3f1d-4fa1-a6f9-785243fab996 req-f75f0705-df41-44de-bc29-08115416b5bd tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:43.016058 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3cd4b915-3f1d-4fa1-a6f9-785243fab996 req-f75f0705-df41-44de-bc29-08115416b5bd tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0498292 Nov 15 17:50:43.065403 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3cd4b915-3f1d-4fa1-a6f9-785243fab996 req-2328ce31-09a7-40b9-b4bc-acc779b089a5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428100 Nov 15 17:50:43.069373 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:43.254044 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef1cc32-3ebe-4982-a976-64accd2f1256 req-fcc329ed-4103-4abf-82c7-1ac6cb4caeed tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:43.255729 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6ef1cc32-3ebe-4982-a976-64accd2f1256 req-fcc329ed-4103-4abf-82c7-1ac6cb4caeed tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 944 time: 0.0502977 Nov 15 17:50:43.303323 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6ef1cc32-3ebe-4982-a976-64accd2f1256 req-6f888ee4-be24-425b-a7f7-bebde1643908 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404787 Nov 15 17:50:43.785128 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1626960-42b6-4aa4-8cf4-ed48d343c954 req-d3775742-13a7-451e-af1f-ad518e6093b9 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:43.786579 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f1626960-42b6-4aa4-8cf4-ed48d343c954 req-d3775742-13a7-451e-af1f-ad518e6093b9 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0544760 Nov 15 17:50:43.832795 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f1626960-42b6-4aa4-8cf4-ed48d343c954 req-32d0f195-dd2a-41de-a842-515b6a8c35b1 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401709 Nov 15 17:50:44.200279 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f427cece-337e-4aae-b30e-72951f51323b req-1dc1726a-420a-4545-9c4e-dde7f811fef0 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:44.201773 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f427cece-337e-4aae-b30e-72951f51323b req-1dc1726a-420a-4545-9c4e-dde7f811fef0 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0557103 Nov 15 17:50:44.250978 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f427cece-337e-4aae-b30e-72951f51323b req-4df916fe-141f-4ca5-89e1-d5eab68a38fc tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431519 Nov 15 17:50:44.433617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0137d3d8-8148-4785-9828-83eadb7d07fc req-b9a4095e-6844-416d-b083-5ca4a0598809 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:44.435116 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0137d3d8-8148-4785-9828-83eadb7d07fc req-b9a4095e-6844-416d-b083-5ca4a0598809 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 944 time: 0.0615804 Nov 15 17:50:44.536365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a154714d-3387-4306-9cdc-62710207de85 req-658af744-7853-4c70-a6fc-e320e4a45ad4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:44.537729 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a154714d-3387-4306-9cdc-62710207de85 req-658af744-7853-4c70-a6fc-e320e4a45ad4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.1003461 Nov 15 17:50:44.541045 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0137d3d8-8148-4785-9828-83eadb7d07fc req-4a63a1ae-76d0-4bc9-9431-8bbbc7fcea27 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933344 Nov 15 17:50:44.584903 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a154714d-3387-4306-9cdc-62710207de85 req-2248163b-14b0-4c84-8763-a7da1ea2fd04 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410926 Nov 15 17:50:45.377556 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a410df72-7a90-4908-8d30-40ab43599c37 req-acca04de-86be-47a5-9f85-c8df8c34e8c3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:45.379206 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a410df72-7a90-4908-8d30-40ab43599c37 req-acca04de-86be-47a5-9f85-c8df8c34e8c3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0501006 Nov 15 17:50:45.440029 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a410df72-7a90-4908-8d30-40ab43599c37 req-71d0f60e-282e-47b4-b235-65d5d7d0a961 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520103 Nov 15 17:50:45.677987 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e996df28-95db-402c-b9ed-b08b89ff0a94 req-11873c72-79a8-420b-90d7-116e34ceb31a tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:45.679458 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e996df28-95db-402c-b9ed-b08b89ff0a94 req-11873c72-79a8-420b-90d7-116e34ceb31a tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 944 time: 0.0600517 Nov 15 17:50:45.727394 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e996df28-95db-402c-b9ed-b08b89ff0a94 req-282c7696-d0fd-45dd-87a0-3e8878df05ca tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409429 Nov 15 17:50:45.831731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba66d081-7c47-4ba4-b5c6-742339215baf req-008493a0-12dd-4415-9f2d-8a3a36ffcc80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:45.833195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ba66d081-7c47-4ba4-b5c6-742339215baf req-008493a0-12dd-4415-9f2d-8a3a36ffcc80 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0489831 Nov 15 17:50:45.881463 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ba66d081-7c47-4ba4-b5c6-742339215baf req-5096da6f-c02c-4ad5-9975-41dd985844df tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423071 Nov 15 17:50:46.578747 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7243041-f2fb-426e-a4e9-aad7b390ca7f req-6f76c3bf-7bee-49de-a1bd-3265871ceec5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:46.580236 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d7243041-f2fb-426e-a4e9-aad7b390ca7f req-6f76c3bf-7bee-49de-a1bd-3265871ceec5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0703044 Nov 15 17:50:46.628318 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d7243041-f2fb-426e-a4e9-aad7b390ca7f req-b2779b5f-854e-4aca-8fa6-0fd6272177b3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420661 Nov 15 17:50:46.853501 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2e8873-e66f-4fd2-9155-08160ce623d8 req-1ad0548e-b6b6-4377-b3dc-1895817c932b tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:46.854966 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e2e8873-e66f-4fd2-9155-08160ce623d8 req-1ad0548e-b6b6-4377-b3dc-1895817c932b tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 944 time: 0.0503995 Nov 15 17:50:46.901319 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e2e8873-e66f-4fd2-9155-08160ce623d8 req-5deb95b9-1ed2-4777-8c56-65e8b571599b tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400498 Nov 15 17:50:47.004811 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57804086-a644-43c4-b4bf-6c552db0f633 req-b40c5cc2-e3ed-4a47-adb9-3dc26ad5f9a8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.006282 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-57804086-a644-43c4-b4bf-6c552db0f633 req-b40c5cc2-e3ed-4a47-adb9-3dc26ad5f9a8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0512273 Nov 15 17:50:47.063082 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-57804086-a644-43c4-b4bf-6c552db0f633 req-99039069-d9bd-40a8-a346-02b39613f712 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476284 Nov 15 17:50:47.111732 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-c6a0b210-50f5-4f38-a99d-280afc31b108 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.113272 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-c6a0b210-50f5-4f38-a99d-280afc31b108 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0418992 Nov 15 17:50:47.210754 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-e1f25aee-f99f-4890-8946-ef1da654f401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.212233 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-e1f25aee-f99f-4890-8946-ef1da654f401 service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.0903389 Nov 15 17:50:47.272538 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-52fbdf63-b6a8-4dba-9d04-8391a93dee8d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0440583 Nov 15 17:50:47.333201 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-c795f355-a2c4-47d0-a0cc-670006404c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.334648 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-c795f355-a2c4-47d0-a0cc-670006404c2c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0443628 Nov 15 17:50:47.372860 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-b583d5f2-f30e-462d-979b-db35f15f92e8 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0274649 Nov 15 17:50:47.472806 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-255ca917-04cc-49ef-b615-08972b6ba27b service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898585 Nov 15 17:50:47.562960 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec29b6f0-f8c3-4188-bbb4-1efb22842f90 req-bc44d550-94c0-4e6b-8397-2adbb31c695d tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.564483 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ec29b6f0-f8c3-4188-bbb4-1efb22842f90 req-bc44d550-94c0-4e6b-8397-2adbb31c695d tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0506670 Nov 15 17:50:47.577712 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a18b6bc-e09f-463b-b9a3-175c814c3905 req-4db6e840-19c2-46fc-8789-668af23c1891 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944417 Nov 15 17:50:47.611860 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ec29b6f0-f8c3-4188-bbb4-1efb22842f90 req-c0bfe032-f396-4383-821c-5c051e98813a tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410721 Nov 15 17:50:47.758515 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ebfb65a-b05e-4bfe-b0c7-94537926b285 req-6260d0b6-e416-4295-ae02-5de5d4914267 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:47.760004 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ebfb65a-b05e-4bfe-b0c7-94537926b285 req-6260d0b6-e416-4295-ae02-5de5d4914267 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0538082 Nov 15 17:50:47.807032 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ebfb65a-b05e-4bfe-b0c7-94537926b285 req-d9873832-ba4d-40a9-8993-a55144d70b52 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410118 Nov 15 17:50:48.250836 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-552b15bd-2468-4edd-8568-84d9f4a3b5a9 req-f3937afa-c472-47b1-a50f-8628e0002ead tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:48.252378 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-552b15bd-2468-4edd-8568-84d9f4a3b5a9 req-f3937afa-c472-47b1-a50f-8628e0002ead tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 944 time: 0.2833941 Nov 15 17:50:48.290979 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f22cf00-f29b-4eb1-a791-30211bd363c4 req-1cf6041d-6860-4aab-9b9b-88760544371b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:48.292492 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4f22cf00-f29b-4eb1-a791-30211bd363c4 req-1cf6041d-6860-4aab-9b9b-88760544371b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0782177 Nov 15 17:50:48.331527 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-552b15bd-2468-4edd-8568-84d9f4a3b5a9 req-30522e9e-e6ea-4f1a-aa0b-43d533e45238 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729053 Nov 15 17:50:48.364879 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4f22cf00-f29b-4eb1-a791-30211bd363c4 req-d8436e30-f834-44af-b847-129ef0d34e38 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642076 Nov 15 17:50:48.481514 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:50:48.540329 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:50:48.544111 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:50:48.544504 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:48.628441 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:48.654709 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:48.657585 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e89a3b8-0c6f-4954-b7f0-03f7611a949a" -d '{"events": [{"server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "name": "network-vif-plugged", "status": "completed", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:48.670358 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:48.677442 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:48.711722 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19f12488-93d0-4fae-92c9-c64db7eb38ee x-openstack-request-id: req-19f12488-93d0-4fae-92c9-c64db7eb38ee {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:48.712045 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "name": "network-vif-plugged", "status": "completed", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:48.712297 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-19f12488-93d0-4fae-92c9-c64db7eb38ee {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:48.712705 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881', 'code': 200} Nov 15 17:50:48.735680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:48.745239 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8698f6-d749-4036-bde4-553b4b7622e5 req-eb705c58-29f6-4ef5-bce6-7f122528ca1c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:48.746724 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8a8698f6-d749-4036-bde4-553b4b7622e5 req-eb705c58-29f6-4ef5-bce6-7f122528ca1c tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0501111 Nov 15 17:50:48.798046 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8a8698f6-d749-4036-bde4-553b4b7622e5 req-0c3bbba5-0cce-43b0-8351-999ceebe8426 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/security-groups?id=ef9e1c0c-0ed0-4993-8ecb-6610248183a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452275 Nov 15 17:50:48.915162 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1397e572-b015-4058-811b-958abb029631 req-6e703c3a-ad54-481c-8c5b-2a4c142ea135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:48.916613 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1397e572-b015-4058-811b-958abb029631 req-6e703c3a-ad54-481c-8c5b-2a4c142ea135 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 1098 time: 0.0392296 Nov 15 17:50:48.929520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815506f2-7760-4881-bc40-1be57c6b9231 req-bbf7c2ee-9427-422c-879f-10cca72d5d41 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:48.930969 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-815506f2-7760-4881-bc40-1be57c6b9231 req-bbf7c2ee-9427-422c-879f-10cca72d5d41 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0472653 Nov 15 17:50:48.974936 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1397e572-b015-4058-811b-958abb029631 req-82712666-ec04-4d5a-935a-0e3c83b4ea9d service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375319 Nov 15 17:50:48.977758 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-815506f2-7760-4881-bc40-1be57c6b9231 req-6a66631d-b84e-4dc5-9ba1-dac504a74345 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398269 Nov 15 17:50:49.496250 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845b5a4e-8d7a-4eff-832b-972912965a91 req-57d4f0bc-497d-4916-984a-097b450c04b9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:49.497753 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-845b5a4e-8d7a-4eff-832b-972912965a91 req-57d4f0bc-497d-4916-984a-097b450c04b9 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0885966 Nov 15 17:50:49.515947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-01f8ef7e-2550-4bcf-911d-9fd413815f46 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:49.516237 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c78e04a-ebc6-44d3-a27b-a3af4c7dadbc req-4426e2db-daae-4ea9-80bd-3488d2b8cfa3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:49.517675 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-01f8ef7e-2550-4bcf-911d-9fd413815f46 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 945 time: 0.0642114 Nov 15 17:50:49.517831 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5c78e04a-ebc6-44d3-a27b-a3af4c7dadbc req-4426e2db-daae-4ea9-80bd-3488d2b8cfa3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0778661 Nov 15 17:50:49.599061 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-845b5a4e-8d7a-4eff-832b-972912965a91 req-27d30423-9dd7-41d5-a5c3-edb904734f7d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905657 Nov 15 17:50:49.602619 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5c78e04a-ebc6-44d3-a27b-a3af4c7dadbc req-60c3a333-bd77-4709-b37f-9bfc21a83be3 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790091 Nov 15 17:50:49.630627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Deleting port 237c8e48-cb73-47e3-898c-9a923e7b48c3 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:50:49.630967 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:49.720130 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] For port 237c8e48-cb73-47e3-898c-9a923e7b48c3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=237c8e48-cb73-47e3-898c-9a923e7b48c3,segment=NetworkSegment(87006e21-df9a-4769-925c-1d4d72189624),segment_id=87006e21-df9a-4769-925c-1d4d72189624)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:50:49.720491 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:49.732456 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Calling delete_port for 237c8e48-cb73-47e3-898c-9a923e7b48c3 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:50:49.864117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:49.876922 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['237c8e48-cb73-47e3-898c-9a923e7b48c3'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:50:49.897336 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Pushing event deleted for resources: {'Port': ['ID=237c8e48-cb73-47e3-898c-9a923e7b48c3,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:50:49.908334 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8fd604ab-ddc8-4604-9ee7-e2dc30b56a33 req-7d259097-b254-4d89-b039-a304ed414663 tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.31 "GET /v2.0/ports?device_id=778a6f3d-6162-43ef-9e49-07df35c07303 HTTP/1.1" status: 200 len: 210 time: 0.0358911 Nov 15 17:50:49.934736 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] No DVR routers for this DVR port 237c8e48-cb73-47e3-898c-9a923e7b48c3 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:50:49.937317 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:49.940730 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-eba007dd-da92-4ed7-896d-ae8b9998303f req-187885d7-c7f2-4629-8e9b-6ecfca34232b tempest-VolumesActionsTest-1067168883 tempest-VolumesActionsTest-1067168883-project] 10.222.0.48 "DELETE /v2.0/ports/237c8e48-cb73-47e3-898c-9a923e7b48c3 HTTP/1.1" status: 204 len: 173 time: 0.4139102 Nov 15 17:50:49.941175 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'name': 'network-vif-deleted', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:50:49.943434 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f43edb5-f093-42c9-ad05-38e5cd307b31" -d '{"events": [{"server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "name": "network-vif-deleted", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:50:49.980796 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:50:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef8d18ed-28b1-4618-9f15-cbbd93339957 x-openstack-request-id: req-ef8d18ed-28b1-4618-9f15-cbbd93339957 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:50:49.981081 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "778a6f3d-6162-43ef-9e49-07df35c07303", "name": "network-vif-deleted", "tag": "237c8e48-cb73-47e3-898c-9a923e7b48c3", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:50:49.981331 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ef8d18ed-28b1-4618-9f15-cbbd93339957 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:50:49.981718 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '778a6f3d-6162-43ef-9e49-07df35c07303', 'name': 'network-vif-deleted', 'tag': '237c8e48-cb73-47e3-898c-9a923e7b48c3', 'status': 'completed', 'code': 200} Nov 15 17:50:50.094745 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8053ff1-229c-439a-9607-a12702f9f989 req-b6c5149f-1392-4490-9584-a3d5070fb48b tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:50.096102 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8053ff1-229c-439a-9607-a12702f9f989 req-b6c5149f-1392-4490-9584-a3d5070fb48b tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0509820 Nov 15 17:50:50.148893 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8053ff1-229c-439a-9607-a12702f9f989 req-84d893c0-3bda-43ea-926f-940f1604b80a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466232 Nov 15 17:50:50.787578 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093415c0-c27a-421c-bdc3-71f04b368873 req-e6701fc9-a62e-407e-a64d-a5260ccb9fb1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:50.789057 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-093415c0-c27a-421c-bdc3-71f04b368873 req-e6701fc9-a62e-407e-a64d-a5260ccb9fb1 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0747168 Nov 15 17:50:50.799308 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982dae73-a1c6-450e-8ef6-495ba6ce199e req-bb63b5e7-22fd-498f-bf93-2ef146ef9c15 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:50.800681 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-982dae73-a1c6-450e-8ef6-495ba6ce199e req-bb63b5e7-22fd-498f-bf93-2ef146ef9c15 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0851066 Nov 15 17:50:50.870564 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-093415c0-c27a-421c-bdc3-71f04b368873 req-b2b1427a-af0a-40d0-8726-2565fe1eb26e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688846 Nov 15 17:50:50.874590 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-982dae73-a1c6-450e-8ef6-495ba6ce199e req-1287f27d-b00a-4ad6-8109-ed17a1d39dea tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667219 Nov 15 17:50:51.277358 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e6e38e-d934-4f2f-848f-564a09ba6d1a req-ce82a68c-d1b3-40fa-bde9-380376627aed tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:51.278885 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c8e6e38e-d934-4f2f-848f-564a09ba6d1a req-ce82a68c-d1b3-40fa-bde9-380376627aed tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0533590 Nov 15 17:50:51.328552 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c8e6e38e-d934-4f2f-848f-564a09ba6d1a req-e4034e9a-a8a6-4d79-9aea-0d6c55443f2b tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418344 Nov 15 17:50:51.989277 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc1f4c9-e52e-4a4c-8733-622089e9b078 req-ac06b92e-8fae-48f6-80ab-9a26e7863e7d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:51.990846 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1cc1f4c9-e52e-4a4c-8733-622089e9b078 req-ac06b92e-8fae-48f6-80ab-9a26e7863e7d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0493505 Nov 15 17:50:52.043938 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1cc1f4c9-e52e-4a4c-8733-622089e9b078 req-f764e6d3-a61e-43b8-8c87-390169b43063 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453331 Nov 15 17:50:52.320284 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:50:54.736674 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 237c8e48-cb73-47e3-898c-9a923e7b48c3 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:50:54.757849 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 237c8e48-cb73-47e3-898c-9a923e7b48c3 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:50:54.758377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 237c8e48-cb73-47e3-898c-9a923e7b48c3 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:50:54.856915 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae6abd3-ef3c-41d3-9434-80b91f33692d req-56e71c41-3f08-46b1-8f28-33cdb2761fcf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:54.858631 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4ae6abd3-ef3c-41d3-9434-80b91f33692d req-56e71c41-3f08-46b1-8f28-33cdb2761fcf tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0553005 Nov 15 17:50:54.924012 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4ae6abd3-ef3c-41d3-9434-80b91f33692d req-2ef3e297-f52d-4512-b0b6-afed1c9f25f1 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482264 Nov 15 17:50:55.023074 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e400fb1-7dfa-40c9-ac01-0dc5790da8d7 req-dfb83691-f745-49aa-aa92-226eceb46a58 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:55.024853 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e400fb1-7dfa-40c9-ac01-0dc5790da8d7 req-dfb83691-f745-49aa-aa92-226eceb46a58 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0519705 Nov 15 17:50:55.072827 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e400fb1-7dfa-40c9-ac01-0dc5790da8d7 req-9b0f29a7-1af4-469c-acdc-4745eca10e5d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415859 Nov 15 17:50:56.058381 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf8c56f-c97b-42fa-bbcd-466c88c48963 req-4cd5e89e-96be-4d52-aa42-0fffba574366 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:56.059907 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ddf8c56f-c97b-42fa-bbcd-466c88c48963 req-4cd5e89e-96be-4d52-aa42-0fffba574366 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0479605 Nov 15 17:50:56.107456 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ddf8c56f-c97b-42fa-bbcd-466c88c48963 req-f8e521b0-cf17-4747-bf19-021638d2b697 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412216 Nov 15 17:50:56.211967 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dce3101-deec-4108-9ea4-f16b36077293 req-dfc0b0df-bfc8-4d72-a606-9e9c9b151955 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:56.213501 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6dce3101-deec-4108-9ea4-f16b36077293 req-dfc0b0df-bfc8-4d72-a606-9e9c9b151955 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0526335 Nov 15 17:50:56.261821 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6dce3101-deec-4108-9ea4-f16b36077293 req-e360b839-2d3b-4050-88b2-7300517d87ff tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421827 Nov 15 17:50:57.232423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df99b04d-08bb-47c4-ac88-a2b8303681d8 req-4aabbbe8-df2c-43d9-b89a-f25cf96537c1 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.236041 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-df99b04d-08bb-47c4-ac88-a2b8303681d8 req-4aabbbe8-df2c-43d9-b89a-f25cf96537c1 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0534644 Nov 15 17:50:57.290023 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-df99b04d-08bb-47c4-ac88-a2b8303681d8 req-8e7ebac3-018f-4d90-8b0b-39c6f7f88a7e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472376 Nov 15 17:50:57.424147 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aecc21d5-a58d-4409-b043-dce7c368bede req-253b4a82-9a2a-4b17-9d7a-e83d418de822 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.427427 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aecc21d5-a58d-4409-b043-dce7c368bede req-253b4a82-9a2a-4b17-9d7a-e83d418de822 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0708425 Nov 15 17:50:57.525156 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aecc21d5-a58d-4409-b043-dce7c368bede req-bfa97ac0-7bf1-46f2-9973-a0783eda41be tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905986 Nov 15 17:50:57.588639 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f346484-cda7-48c7-bd2c-721def0834d0 req-16ed23f9-bd25-414e-88f6-e0cb03fd0e19 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.590223 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0f346484-cda7-48c7-bd2c-721def0834d0 req-16ed23f9-bd25-414e-88f6-e0cb03fd0e19 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0640967 Nov 15 17:50:57.628573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15206937-8336-4c46-8236-638522e186ba req-17fc5d38-a653-4197-a7f3-c3fbcaddc24e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.630861 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-17fc5d38-a653-4197-a7f3-c3fbcaddc24e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1099 time: 0.0427151 Nov 15 17:50:57.661033 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0f346484-cda7-48c7-bd2c-721def0834d0 req-cdf38fd8-11f1-4633-a359-60dad6083c13 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632906 Nov 15 17:50:57.742082 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15206937-8336-4c46-8236-638522e186ba req-b850d280-2762-4f89-b3be-12aed5a5e554 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.744146 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-b850d280-2762-4f89-b3be-12aed5a5e554 service neutron] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 912 time: 0.0995655 Nov 15 17:50:57.826175 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-0af0c5d9-26db-45f5-b348-cff8ddc3c1de service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 1002 time: 0.0682795 Nov 15 17:50:57.892509 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15206937-8336-4c46-8236-638522e186ba req-65394fd9-f994-404b-a018-5e0922f9a1b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.893872 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-65394fd9-f994-404b-a018-5e0922f9a1b3 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0475137 Nov 15 17:50:57.950510 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15206937-8336-4c46-8236-638522e186ba req-28ddae25-f90a-4f0a-b5ea-a102fe705a99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:57.952030 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-28ddae25-f90a-4f0a-b5ea-a102fe705a99 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0463827 Nov 15 17:50:58.080856 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-571e3a5b-0189-4e7e-9f96-34f6ffaf2a2b service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1192579 Nov 15 17:50:58.194432 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-15206937-8336-4c46-8236-638522e186ba req-74959c39-b911-4e4d-babb-bf68d2e794df service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023088 Nov 15 17:50:58.657504 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64661bc1-81d2-4a27-be3c-80dd33bd27ee req-484b25f5-644a-42da-b151-db6db9817e61 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:58.660534 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-64661bc1-81d2-4a27-be3c-80dd33bd27ee req-484b25f5-644a-42da-b151-db6db9817e61 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0578351 Nov 15 17:50:58.735340 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-64661bc1-81d2-4a27-be3c-80dd33bd27ee req-86f4c44a-c4a5-48fe-9ac2-9d06964bd98a tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663188 Nov 15 17:50:58.801437 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca8893d-3b63-4aa2-a252-112264ad4dae req-dc8b4f28-d1f8-406b-9c8b-53c4e2a7cf49 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:58.803146 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8ca8893d-3b63-4aa2-a252-112264ad4dae req-dc8b4f28-d1f8-406b-9c8b-53c4e2a7cf49 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0626395 Nov 15 17:50:58.859248 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8ca8893d-3b63-4aa2-a252-112264ad4dae req-a8c60b6e-c8e5-4c8d-9acb-0f3fafe1b9aa tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494328 Nov 15 17:50:59.856676 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3fef81-bf71-4125-8c0a-e0f69bdefb2b req-bb7bdd98-b447-4f1d-b2b2-dd79b26a229e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:59.858539 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f3fef81-bf71-4125-8c0a-e0f69bdefb2b req-bb7bdd98-b447-4f1d-b2b2-dd79b26a229e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0498443 Nov 15 17:50:59.917564 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f3fef81-bf71-4125-8c0a-e0f69bdefb2b req-167db2d6-c7da-4a6f-bd8b-d9c25bb6be77 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528922 Nov 15 17:50:59.996056 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05c50f8-d10b-4d64-9e9a-00315243e008 req-6709b572-50f8-4c57-bc61-08d7b59dd7a1 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:50:59.997524 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e05c50f8-d10b-4d64-9e9a-00315243e008 req-6709b572-50f8-4c57-bc61-08d7b59dd7a1 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0569074 Nov 15 17:51:00.046032 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e05c50f8-d10b-4d64-9e9a-00315243e008 req-6c47310d-60e4-462d-a85d-9526799f8fb3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422871 Nov 15 17:51:00.782950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-75563b7c-100d-40d7-b8a1-68b522444e0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:01.043169 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fcdcc8-3a58-4545-980f-e6a530b07644 req-07fd8a21-bf55-40b8-ac4d-71390a871b79 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:01.044727 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c3fcdcc8-3a58-4545-980f-e6a530b07644 req-07fd8a21-bf55-40b8-ac4d-71390a871b79 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0546069 Nov 15 17:51:01.100593 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c3fcdcc8-3a58-4545-980f-e6a530b07644 req-bf8f2d54-b9de-401f-9a93-124bc52f5ded tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483618 Nov 15 17:51:02.233015 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230a0a8f-3659-44ce-a37e-5debcb401d69 req-08527343-dcfa-43ea-a9b0-0def48660c7c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:02.234519 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-230a0a8f-3659-44ce-a37e-5debcb401d69 req-08527343-dcfa-43ea-a9b0-0def48660c7c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0563941 Nov 15 17:51:02.295185 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-230a0a8f-3659-44ce-a37e-5debcb401d69 req-003a8ffe-fff7-4676-9b82-20f35ff47d70 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530136 Nov 15 17:51:03.068643 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-980d1423-bfdc-4948-9552-cb379e9fc1a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:03.429150 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec395068-f610-4e3e-9739-be4689b5e9cb req-511c8318-17d4-4d46-827c-ed641db8ebd2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:03.430919 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ec395068-f610-4e3e-9739-be4689b5e9cb req-511c8318-17d4-4d46-827c-ed641db8ebd2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0571103 Nov 15 17:51:03.481999 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ec395068-f610-4e3e-9739-be4689b5e9cb req-5ccb9886-668d-408f-b2e8-25da5d5885c2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447757 Nov 15 17:51:04.459290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:04.600577 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0a99a0-98ae-48d0-a33a-5969e9caf640 req-1c67b885-e7f7-4f7f-a7bd-342624e5d484 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:04.602900 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ea0a99a0-98ae-48d0-a33a-5969e9caf640 req-1c67b885-e7f7-4f7f-a7bd-342624e5d484 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0489995 Nov 15 17:51:04.651831 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ea0a99a0-98ae-48d0-a33a-5969e9caf640 req-3b9895b9-4016-4956-a275-00cfc44fa497 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425434 Nov 15 17:51:05.562322 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:05.776999 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f56a54-d0e2-4e61-8146-812cd99e6555 req-d3759557-6e43-4577-a3f4-8dc64fdd72ea tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:05.778465 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8f56a54-d0e2-4e61-8146-812cd99e6555 req-d3759557-6e43-4577-a3f4-8dc64fdd72ea tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0545487 Nov 15 17:51:05.830131 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8f56a54-d0e2-4e61-8146-812cd99e6555 req-b29da61f-5b64-4b9d-92bf-bb5e1855ac85 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452604 Nov 15 17:51:06.466079 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78357d2b-aa26-432e-a077-61c40852febd req-c346dcbb-fc08-4130-991f-64196c87e65f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:06.468371 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-78357d2b-aa26-432e-a077-61c40852febd req-c346dcbb-fc08-4130-991f-64196c87e65f tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0513783 Nov 15 17:51:06.520029 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-78357d2b-aa26-432e-a077-61c40852febd req-17eca56a-88b8-4c3a-9324-591ce2a86a0a tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461967 Nov 15 17:51:06.663673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:06.959878 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e539d75-7373-463e-a86d-771a26a94311 req-1cf0df44-c2ab-42e6-8952-e2d7d224180e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:06.961708 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e539d75-7373-463e-a86d-771a26a94311 req-1cf0df44-c2ab-42e6-8952-e2d7d224180e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0588136 Nov 15 17:51:07.022413 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e539d75-7373-463e-a86d-771a26a94311 req-dd26bbb6-0a44-4d2c-99b0-6f14d4eaefb4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519838 Nov 15 17:51:07.653247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f128af-01fb-486c-b305-18ccf2c9fe93 req-61f20fe0-4efd-4e28-a935-f56928e1bfc8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:07.656243 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e1f128af-01fb-486c-b305-18ccf2c9fe93 req-61f20fe0-4efd-4e28-a935-f56928e1bfc8 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0578284 Nov 15 17:51:07.707475 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e1f128af-01fb-486c-b305-18ccf2c9fe93 req-ff986dc7-f5c0-4630-b94d-ba1797b7fe2c tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447378 Nov 15 17:51:08.150877 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e922046-0f26-470a-b6eb-06f6020b410a req-cb44df71-fe72-42bb-882a-b6d5566fe694 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:08.152547 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e922046-0f26-470a-b6eb-06f6020b410a req-cb44df71-fe72-42bb-882a-b6d5566fe694 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0590868 Nov 15 17:51:08.211319 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e922046-0f26-470a-b6eb-06f6020b410a req-6202e959-e20b-4403-a45f-550d94b70efd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520887 Nov 15 17:51:08.487160 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99f50609-e4c7-4700-b2ec-15f605be974b req-ba84325c-30e4-4066-9a56-d3e03a946fc3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:08.488683 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99f50609-e4c7-4700-b2ec-15f605be974b req-ba84325c-30e4-4066-9a56-d3e03a946fc3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0611064 Nov 15 17:51:08.603946 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Deleting port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:08.604278 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:08.716490 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] For port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:08.716892 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:08.734324 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Calling delete_port for 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:08.845277 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d7f04a5-70f1-4113-bdd4-f2124123a1c2 req-91a76289-6de5-46c2-9c76-c0511cb8006e tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:08.857144 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d7f04a5-70f1-4113-bdd4-f2124123a1c2 req-91a76289-6de5-46c2-9c76-c0511cb8006e tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=42b3e3ad-11f7-460e-b148-0b9c0761a453 HTTP/1.1" status: 200 len: 945 time: 0.0702546 Nov 15 17:51:08.916671 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d7f04a5-70f1-4113-bdd4-f2124123a1c2 req-4ccf45f1-df6a-4e5d-b427-d7f37695a644 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581017 Nov 15 17:51:08.920451 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:08.933206 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237', '51f77003-54ff-44ef-a4c0-98da6c460703', '6ccdae31-65e3-4a19-b710-4eca9f518175', '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:08.966324 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event deleted for resources: {'Port': ['ID=3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:09.020524 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] No DVR routers for this DVR port 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:09.024350 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:09.030997 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99f50609-e4c7-4700-b2ec-15f605be974b req-804bea87-4995-4ed0-be28-016a3701e351 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "DELETE /v2.0/ports/3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 HTTP/1.1" status: 204 len: 173 time: 0.5357559 Nov 15 17:51:09.032062 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'name': 'network-vif-deleted', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:09.036161 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b2bf76f-4e1b-4a70-9081-1c1db39dd33d" -d '{"events": [{"server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "name": "network-vif-deleted", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:09.089911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8bbed17-9a91-4f23-9e5c-c9c272514655 x-openstack-request-id: req-a8bbed17-9a91-4f23-9e5c-c9c272514655 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:09.089911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42b3e3ad-11f7-460e-b148-0b9c0761a453", "name": "network-vif-deleted", "tag": "3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:09.089911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a8bbed17-9a91-4f23-9e5c-c9c272514655 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:09.090943 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42b3e3ad-11f7-460e-b148-0b9c0761a453', 'name': 'network-vif-deleted', 'tag': '3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881', 'status': 'completed', 'code': 200} Nov 15 17:51:09.344675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d6059a-9cb6-4f90-b1e2-6b0c42f36644 req-18d9521c-c6c2-4b3e-9e2b-93f66c59445b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:09.347202 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-85d6059a-9cb6-4f90-b1e2-6b0c42f36644 req-18d9521c-c6c2-4b3e-9e2b-93f66c59445b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0615361 Nov 15 17:51:09.405235 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-85d6059a-9cb6-4f90-b1e2-6b0c42f36644 req-db89f18a-fa59-49ab-ad32-c8ecaa8fdb26 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520720 Nov 15 17:51:10.543327 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab622b7-ea7f-48e2-a04a-6fdbd3550b06 req-13b2ccf6-9ebc-4208-b7d7-25a1c1895c8e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:10.545822 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ab622b7-ea7f-48e2-a04a-6fdbd3550b06 req-13b2ccf6-9ebc-4208-b7d7-25a1c1895c8e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0586233 Nov 15 17:51:10.621147 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7ab622b7-ea7f-48e2-a04a-6fdbd3550b06 req-da93ee5a-6ae2-41be-ba7d-e16bbfdf9577 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689847 Nov 15 17:51:11.329223 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a5924f-baa1-4757-81c4-2485fcb2765b req-500dd54f-0f57-49ab-9715-0fe68125ce73 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:11.331077 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-95a5924f-baa1-4757-81c4-2485fcb2765b req-500dd54f-0f57-49ab-9715-0fe68125ce73 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.0536704 Nov 15 17:51:11.385877 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-95a5924f-baa1-4757-81c4-2485fcb2765b req-a45c7592-b89a-4655-a2ab-8d3ac0bc799d tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484240 Nov 15 17:51:11.755234 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-038b2786-00c0-4fe5-9510-21459a2e6079 req-9d5ab0ab-830d-473a-863b-1de863c38f81 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:11.756767 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-038b2786-00c0-4fe5-9510-21459a2e6079 req-9d5ab0ab-830d-473a-863b-1de863c38f81 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0519602 Nov 15 17:51:11.811352 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-038b2786-00c0-4fe5-9510-21459a2e6079 req-20531cb3-258b-4b95-8dcf-b668b4dd8d03 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486677 Nov 15 17:51:12.048694 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:51:12.513343 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc7983e6-b177-4ea5-8df9-cf20c48d63d9 req-a4a5a47b-6ffd-44b1-bd24-ed78f4a03cfe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:12.514819 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dc7983e6-b177-4ea5-8df9-cf20c48d63d9 req-a4a5a47b-6ffd-44b1-bd24-ed78f4a03cfe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.0551815 Nov 15 17:51:12.564190 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dc7983e6-b177-4ea5-8df9-cf20c48d63d9 req-5d828343-8230-469f-9e4d-834f016a9b25 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419269 Nov 15 17:51:12.783090 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:12.806585 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:12.807074 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 3c3a8ce5-1de4-42b0-b83c-dc6e1ffaf881 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:12.941130 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2b06ef-9de1-4bab-bc3c-8ccaed2a1656 req-7ebdf2da-5cd0-4cbb-865a-f4d6d40f387e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:12.943349 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9a2b06ef-9de1-4bab-bc3c-8ccaed2a1656 req-7ebdf2da-5cd0-4cbb-865a-f4d6d40f387e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0541418 Nov 15 17:51:12.997041 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9a2b06ef-9de1-4bab-bc3c-8ccaed2a1656 req-7142ed82-5372-4038-abbd-acb0afade2a0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473139 Nov 15 17:51:13.266933 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-e505ba54-1af5-4c1b-9c20-2056fc80ff57 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:13.268601 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-e505ba54-1af5-4c1b-9c20-2056fc80ff57 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 946 time: 0.0614321 Nov 15 17:51:13.407279 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Deleting port 6ccdae31-65e3-4a19-b710-4eca9f518175 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:13.407797 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:13.513353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] For port 6ccdae31-65e3-4a19-b710-4eca9f518175, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6ccdae31-65e3-4a19-b710-4eca9f518175,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:13.513814 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:13.530535 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Calling delete_port for 6ccdae31-65e3-4a19-b710-4eca9f518175 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:13.687855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:13.702917 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237', '51f77003-54ff-44ef-a4c0-98da6c460703', '6ccdae31-65e3-4a19-b710-4eca9f518175'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:13.717208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event deleted for resources: {'Port': ['ID=6ccdae31-65e3-4a19-b710-4eca9f518175,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:13.747446 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dc0ca38c-cf73-4b78-9689-59f56ef0a9cd req-795cc973-901d-4f3b-acdc-65eeb63ea500 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b HTTP/1.1" status: 200 len: 210 time: 0.0413578 Nov 15 17:51:13.794861 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] No DVR routers for this DVR port 6ccdae31-65e3-4a19-b710-4eca9f518175 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:13.798445 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:13.803547 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86dc63b6-d5aa-444f-8ec1-9c3043e9d3d3 req-aa5ea5b7-e5db-487f-9163-797e620c70e3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "DELETE /v2.0/ports/6ccdae31-65e3-4a19-b710-4eca9f518175 HTTP/1.1" status: 204 len: 173 time: 0.5282450 Nov 15 17:51:13.804043 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'name': 'network-vif-deleted', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:13.807161 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69a75379-475f-4b65-8eaf-7a27b909b0ba" -d '{"events": [{"server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "name": "network-vif-deleted", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:13.867093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8a0bc83-e2a3-499e-a174-c10e375306ee x-openstack-request-id: req-d8a0bc83-e2a3-499e-a174-c10e375306ee {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:13.867581 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b", "name": "network-vif-deleted", "tag": "6ccdae31-65e3-4a19-b710-4eca9f518175", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:13.867995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-d8a0bc83-e2a3-499e-a174-c10e375306ee {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:13.869204 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76508c8c-ddfe-48f4-aaf9-6c8de8bfd87b', 'name': 'network-vif-deleted', 'tag': '6ccdae31-65e3-4a19-b710-4eca9f518175', 'status': 'completed', 'code': 200} Nov 15 17:51:14.136449 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e8c597-c93e-48ad-9cff-4f1dc331b543 req-32a5d00a-5077-4b53-8895-9121fbe1ac73 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:14.144450 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10e8c597-c93e-48ad-9cff-4f1dc331b543 req-32a5d00a-5077-4b53-8895-9121fbe1ac73 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0639708 Nov 15 17:51:14.218439 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10e8c597-c93e-48ad-9cff-4f1dc331b543 req-020883d5-a6ee-4957-9aca-c3dd191bd211 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570734 Nov 15 17:51:15.061255 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfacdc14-8046-41f6-a23a-9d03c1e070e4 req-6215750a-58a4-4554-bc0a-c0f27cd9a762 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:15.063093 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bfacdc14-8046-41f6-a23a-9d03c1e070e4 req-6215750a-58a4-4554-bc0a-c0f27cd9a762 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0530844 Nov 15 17:51:15.141349 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bfacdc14-8046-41f6-a23a-9d03c1e070e4 req-9716964b-e4d6-4016-a48d-cf096db15244 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711250 Nov 15 17:51:15.341902 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dbd366-a53a-46b2-b8d8-c8f39f5b9458 req-ff60edc4-de8e-4400-932d-1aeaee8592b8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:15.344345 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-92dbd366-a53a-46b2-b8d8-c8f39f5b9458 req-ff60edc4-de8e-4400-932d-1aeaee8592b8 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0749230 Nov 15 17:51:15.393235 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-92dbd366-a53a-46b2-b8d8-c8f39f5b9458 req-2d6a06c2-9a23-4271-be80-075146fef8a5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416534 Nov 15 17:51:15.414706 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967ceaf0-f67e-4370-ad6e-f9dd4542ccd2 req-9f264b81-1b8f-4df2-bcd6-a281022fab7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:15.414706 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-967ceaf0-f67e-4370-ad6e-f9dd4542ccd2 req-9f264b81-1b8f-4df2-bcd6-a281022fab7c service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0388572 Nov 15 17:51:15.459677 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-967ceaf0-f67e-4370-ad6e-f9dd4542ccd2 req-dc2f4035-eb86-4213-a262-449e3b4a554f service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399117 Nov 15 17:51:16.297312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19ebbda-9a70-4ef0-9c9e-be56f51cc42c req-5f003a8e-67e9-4ff6-80bd-5712c98374ba tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:16.300970 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f19ebbda-9a70-4ef0-9c9e-be56f51cc42c req-5f003a8e-67e9-4ff6-80bd-5712c98374ba tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0550587 Nov 15 17:51:16.381171 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f19ebbda-9a70-4ef0-9c9e-be56f51cc42c req-439e9cbc-9c9c-45ab-abc4-00096c75fc80 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709269 Nov 15 17:51:16.556718 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad54aa5-668b-43c9-bb1b-7163327cbe5a req-8b58cb5b-8d91-4640-ae82-4dd1f3a6a220 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:16.561564 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cad54aa5-668b-43c9-bb1b-7163327cbe5a req-8b58cb5b-8d91-4640-ae82-4dd1f3a6a220 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0811446 Nov 15 17:51:16.638573 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cad54aa5-668b-43c9-bb1b-7163327cbe5a req-ea9aae0a-3c1e-42b1-a700-f392233dee59 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704710 Nov 15 17:51:16.819940 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6ccdae31-65e3-4a19-b710-4eca9f518175 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:16.870100 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 6ccdae31-65e3-4a19-b710-4eca9f518175 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:16.870551 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6ccdae31-65e3-4a19-b710-4eca9f518175 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:17.235901 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-220c063a-1884-4a0d-8e08-5eea2c2c48fc tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:17.238429 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-220c063a-1884-4a0d-8e08-5eea2c2c48fc tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0734427 Nov 15 17:51:17.297597 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7378f5ba-ad50-43dd-a72d-7c455acaaba5 req-354b4f99-190b-47e4-bea1-82850a3665d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:17.299778 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7378f5ba-ad50-43dd-a72d-7c455acaaba5 req-354b4f99-190b-47e4-bea1-82850a3665d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.1084008 Nov 15 17:51:17.360235 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7378f5ba-ad50-43dd-a72d-7c455acaaba5 req-f03ab76f-7fe2-41d7-9de4-c218514b853c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545132 Nov 15 17:51:17.361173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Deleting port 51f77003-54ff-44ef-a4c0-98da6c460703 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:17.361995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:17.474629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] For port 51f77003-54ff-44ef-a4c0-98da6c460703, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=51f77003-54ff-44ef-a4c0-98da6c460703,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:17.475521 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:17.491814 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Calling delete_port for 51f77003-54ff-44ef-a4c0-98da6c460703 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:17.510894 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629e6610-1203-4730-a16b-03a84a16820a req-8231c77c-d03a-4c1a-9bf6-9ce032c563fe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:17.518354 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-629e6610-1203-4730-a16b-03a84a16820a req-8231c77c-d03a-4c1a-9bf6-9ce032c563fe tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=eae87258-8a1a-4a78-9add-9da8a3107b39 HTTP/1.1" status: 200 len: 946 time: 0.0634155 Nov 15 17:51:17.583739 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-629e6610-1203-4730-a16b-03a84a16820a req-a0a1f228-d7a8-46e1-b22a-72cebc910bba tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644939 Nov 15 17:51:17.679007 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:17.704443 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237', '51f77003-54ff-44ef-a4c0-98da6c460703'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:17.735158 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event deleted for resources: {'Port': ['ID=51f77003-54ff-44ef-a4c0-98da6c460703,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:17.801073 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] No DVR routers for this DVR port 51f77003-54ff-44ef-a4c0-98da6c460703 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:17.804985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:17.810316 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cbe67b00-c60f-4ef3-a815-c063a8c91624 req-aa00b53e-6ac2-495e-8370-0d43533ae393 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "DELETE /v2.0/ports/51f77003-54ff-44ef-a4c0-98da6c460703 HTTP/1.1" status: 204 len: 173 time: 0.5479670 Nov 15 17:51:17.811556 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'name': 'network-vif-deleted', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:17.815429 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d52f0440-3bbc-4a1a-8122-2cc72b0e3fd3" -d '{"events": [{"server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "name": "network-vif-deleted", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:17.819038 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c12a767-6079-4d70-91e4-67735e025577 req-3daed997-3859-4f3a-895d-d3830c20e0ce tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:17.823052 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c12a767-6079-4d70-91e4-67735e025577 req-3daed997-3859-4f3a-895d-d3830c20e0ce tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0730135 Nov 15 17:51:17.873626 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf54f655-8eb4-417f-ac5e-39122f7364fb x-openstack-request-id: req-cf54f655-8eb4-417f-ac5e-39122f7364fb {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:17.873988 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eae87258-8a1a-4a78-9add-9da8a3107b39", "name": "network-vif-deleted", "tag": "51f77003-54ff-44ef-a4c0-98da6c460703", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:17.874456 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-cf54f655-8eb4-417f-ac5e-39122f7364fb {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:17.874580 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eae87258-8a1a-4a78-9add-9da8a3107b39', 'name': 'network-vif-deleted', 'tag': '51f77003-54ff-44ef-a4c0-98da6c460703', 'status': 'completed', 'code': 200} Nov 15 17:51:17.907747 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c12a767-6079-4d70-91e4-67735e025577 req-04c9f8f3-f397-49e8-9157-a1d680ad0a71 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759041 Nov 15 17:51:18.267290 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-b233cbed-ee0a-4ed3-b78e-6415f06ef5d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:18.269011 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-b233cbed-ee0a-4ed3-b78e-6415f06ef5d8 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0434277 Nov 15 17:51:18.290826 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed5ffe01-6c31-460e-bcac-551bd4935cce req-a71fb628-8881-4b43-a356-3f5cd909644c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:18.299801 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ed5ffe01-6c31-460e-bcac-551bd4935cce req-a71fb628-8881-4b43-a356-3f5cd909644c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0616481 Nov 15 17:51:18.361505 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ed5ffe01-6c31-460e-bcac-551bd4935cce req-9ad25da6-09c9-44c9-b052-5d73c96cf6fd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599942 Nov 15 17:51:18.375757 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-526dc74f-7e4b-488e-af58-d2b8e2a9ae20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:18.376802 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-526dc74f-7e4b-488e-af58-d2b8e2a9ae20 service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.0925450 Nov 15 17:51:18.444086 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-5c9faf9b-174d-48cf-b8d2-853ffdbe3ad1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0471098 Nov 15 17:51:18.527302 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-69307792-def5-4875-b47c-aba38f1af69f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:18.529243 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-69307792-def5-4875-b47c-aba38f1af69f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0742223 Nov 15 17:51:18.530599 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba08e26-79c3-449c-a9b7-e515b52d2c4a req-1b1e10cf-ce25-4f54-9807-49a6d00a04d6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:18.532717 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bba08e26-79c3-449c-a9b7-e515b52d2c4a req-1b1e10cf-ce25-4f54-9807-49a6d00a04d6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0717170 Nov 15 17:51:18.569561 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-1d201d89-9951-4cc6-8cf5-593b31d01d59 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304523 Nov 15 17:51:18.604860 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bba08e26-79c3-449c-a9b7-e515b52d2c4a req-8376e10f-a1ba-4e52-b576-bf71b07e06c3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0665135 Nov 15 17:51:18.746753 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-ca806537-ab69-49a9-9004-73675dd48011 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1643498 Nov 15 17:51:18.870559 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-bf4846f5-5e05-4b47-9faf-77b3a76e3530 req-4c4b0015-feea-4e7a-8266-bca85a799fd0 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1111927 Nov 15 17:51:19.480071 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b85f352-4cd8-441b-9955-31409b33cc7e req-f22cab12-2e71-44a6-9c40-e7330e9ac8ca tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:19.488168 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b85f352-4cd8-441b-9955-31409b33cc7e req-f22cab12-2e71-44a6-9c40-e7330e9ac8ca tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0581644 Nov 15 17:51:19.535352 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2b85f352-4cd8-441b-9955-31409b33cc7e req-e863e0eb-bfc8-4d1d-898e-ee1ea1f837ab tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460327 Nov 15 17:51:19.735505 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18ec503-c076-4a9a-af53-27ed0dd2c62e req-b096862a-ac2d-47c2-aaa0-714c7dd07f21 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:19.737335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d18ec503-c076-4a9a-af53-27ed0dd2c62e req-b096862a-ac2d-47c2-aaa0-714c7dd07f21 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0592699 Nov 15 17:51:19.822598 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d18ec503-c076-4a9a-af53-27ed0dd2c62e req-355d2e55-e347-47c0-a5bc-0a53a54342f5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779672 Nov 15 17:51:20.163611 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf27d34-e253-41c1-9511-01b87f8fed6d req-12c23c28-0f41-4fec-86c3-9a57fe216c11 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:20.165466 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fdf27d34-e253-41c1-9511-01b87f8fed6d req-12c23c28-0f41-4fec-86c3-9a57fe216c11 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0599413 Nov 15 17:51:20.235829 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fdf27d34-e253-41c1-9511-01b87f8fed6d req-9f255c89-e020-4bdb-9ace-72d4fe4bdb00 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606551 Nov 15 17:51:20.605099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-7320b2d8-0796-4e65-957f-fea4b5d6ec48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:20.606994 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-7320b2d8-0796-4e65-957f-fea4b5d6ec48 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 1099 time: 0.0579729 Nov 15 17:51:20.685570 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccf7ca4-b260-4a16-bf33-84b151ba6c2a req-960a9ff5-695c-4483-8938-c21aaf154f1f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:20.690170 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fccf7ca4-b260-4a16-bf33-84b151ba6c2a req-960a9ff5-695c-4483-8938-c21aaf154f1f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0715587 Nov 15 17:51:20.817444 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fccf7ca4-b260-4a16-bf33-84b151ba6c2a req-b880ba5c-8704-4a6a-9c96-e8c41cd6906c tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1176975 Nov 15 17:51:20.833226 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 51f77003-54ff-44ef-a4c0-98da6c460703 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:20.918199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 51f77003-54ff-44ef-a4c0-98da6c460703 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:20.921508 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 51f77003-54ff-44ef-a4c0-98da6c460703 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:21.010221 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2141299-d8d6-4113-a44d-6600bfcda00b req-da4ed668-3f80-4278-ac41-0f354f4048b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:21.012941 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2141299-d8d6-4113-a44d-6600bfcda00b req-da4ed668-3f80-4278-ac41-0f354f4048b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0825820 Nov 15 17:51:21.046435 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-721687a8-c402-439b-9a1c-6bbfeb907d73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:21.048334 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-721687a8-c402-439b-9a1c-6bbfeb907d73 service neutron] 10.222.0.48 "GET /v2.0/networks?id=f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 200 len: 920 time: 0.4035406 Nov 15 17:51:21.088564 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a2141299-d8d6-4113-a44d-6600bfcda00b req-64c953ef-e8a9-43f3-a33b-1f8abe4eb389 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0639405 Nov 15 17:51:21.097129 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-55664aaa-71b8-4e92-984f-0516e3a50f65 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 200 len: 217 time: 0.0364749 Nov 15 17:51:21.159059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-ec98cf50-934f-47b3-ba13-a0564b222b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:21.161125 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-ec98cf50-934f-47b3-ba13-a0564b222b06 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 200 len: 859 time: 0.0493162 Nov 15 17:51:21.198829 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-b6491bce-08b8-4b2d-b03b-9bd5f2e96d47 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=f25d23f6-7f59-4624-979f-a398984b16c9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291469 Nov 15 17:51:21.306049 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-e9f1bd87-c644-4021-a274-319cc95cbf1b service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0971203 Nov 15 17:51:21.359301 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fe6571-299b-48a8-9ef8-b628569fecc4 req-ed0274ce-e988-46ff-a45b-c4b4e79128b1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:21.361409 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-37fe6571-299b-48a8-9ef8-b628569fecc4 req-ed0274ce-e988-46ff-a45b-c4b4e79128b1 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0519760 Nov 15 17:51:21.421266 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4f131496-10a9-4eda-b8b6-0f6802dd50f5 req-00bdbb4d-72b2-433e-8c05-d9564671d634 service neutron] 10.222.0.48 "GET /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047139 Nov 15 17:51:21.436291 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-37fe6571-299b-48a8-9ef8-b628569fecc4 req-3a8842db-f633-42c5-87f1-c06ac7e3b5f7 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/security-groups?id=742e6151-6dd5-4b0b-a0b5-305643083373&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689473 Nov 15 17:51:21.956240 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e7e0b1-7b4d-4498-8853-297902df00e1 req-766ba744-552d-437e-98c4-8938a5fc8679 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:21.958547 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9e7e0b1-7b4d-4498-8853-297902df00e1 req-766ba744-552d-437e-98c4-8938a5fc8679 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0551448 Nov 15 17:51:22.009262 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9e7e0b1-7b4d-4498-8853-297902df00e1 req-8940cafa-954a-4bd4-9ccc-ec4e6dfc12ba tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446372 Nov 15 17:51:22.170012 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-1f4688e6-0999-42b9-8f27-755e402f4538 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:22.171600 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-1f4688e6-0999-42b9-8f27-755e402f4538 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 945 time: 0.0536864 Nov 15 17:51:22.224866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6614a1b5-7ffd-45a0-bc9e-888767855c05 req-1926b573-a389-4042-b2cb-859cd753cc70 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:22.226388 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6614a1b5-7ffd-45a0-bc9e-888767855c05 req-1926b573-a389-4042-b2cb-859cd753cc70 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0551825 Nov 15 17:51:22.284648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Deleting port 6eb8cabb-711a-47ac-965c-82db4534f237 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:22.285492 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:22.292548 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6614a1b5-7ffd-45a0-bc9e-888767855c05 req-ac32ada5-768d-4871-b8db-b74565c13c95 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538917 Nov 15 17:51:22.333277 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:22.388807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] For port 6eb8cabb-711a-47ac-965c-82db4534f237, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=6eb8cabb-711a-47ac-965c-82db4534f237,segment=NetworkSegment(c2c03eb5-8651-4f4e-bbb7-e7f1b266074d),segment_id=c2c03eb5-8651-4f4e-bbb7-e7f1b266074d)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:22.389229 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:22.402009 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Calling delete_port for 6eb8cabb-711a-47ac-965c-82db4534f237 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:22.537712 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:22.557760 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-99baf8d6-dfe9-45df-958c-fa337b7f37af req-30c9a797-ff5c-4438-ba97-639bf41b12d3 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.31 "GET /v2.0/ports?device_id=fcf7a3be-f466-4299-94b3-06f627fc404e HTTP/1.1" status: 200 len: 210 time: 0.0329945 Nov 15 17:51:22.561236 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['6eb8cabb-711a-47ac-965c-82db4534f237'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:22.570108 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Pushing event deleted for resources: {'Port': ['ID=6eb8cabb-711a-47ac-965c-82db4534f237,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:22.619488 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] No DVR routers for this DVR port 6eb8cabb-711a-47ac-965c-82db4534f237 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:22.622069 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:22.625632 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-446babf2-c94e-41d4-862d-ff933a30e3ed req-5fa58884-a521-4d4d-9d58-e2964a493176 tempest-AttachVolumeNegativeTest-1655260078 tempest-AttachVolumeNegativeTest-1655260078-project] 10.222.0.48 "DELETE /v2.0/ports/6eb8cabb-711a-47ac-965c-82db4534f237 HTTP/1.1" status: 204 len: 173 time: 0.4454966 Nov 15 17:51:22.626082 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'name': 'network-vif-deleted', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:22.628560 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6cbef802-fbcd-4ddf-84c2-c07dbfd52308" -d '{"events": [{"server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "name": "network-vif-deleted", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:22.684531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e8542a3-5e81-4814-a457-c77ee243fad4 x-openstack-request-id: req-3e8542a3-5e81-4814-a457-c77ee243fad4 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:22.684531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fcf7a3be-f466-4299-94b3-06f627fc404e", "name": "network-vif-deleted", "tag": "6eb8cabb-711a-47ac-965c-82db4534f237", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:22.684531 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-3e8542a3-5e81-4814-a457-c77ee243fad4 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:22.685011 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcf7a3be-f466-4299-94b3-06f627fc404e', 'name': 'network-vif-deleted', 'tag': '6eb8cabb-711a-47ac-965c-82db4534f237', 'status': 'completed', 'code': 200} Nov 15 17:51:23.407137 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7f3ba6-057a-4a21-ac76-b65955d2749e req-b9b7c27e-93df-4b0e-b239-d6b4135b9d36 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:23.408757 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1a7f3ba6-057a-4a21-ac76-b65955d2749e req-b9b7c27e-93df-4b0e-b239-d6b4135b9d36 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0531013 Nov 15 17:51:23.457011 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1a7f3ba6-057a-4a21-ac76-b65955d2749e req-9faae28a-1130-49e7-b4e7-7b8e48c1576b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421717 Nov 15 17:51:23.616474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 56890) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:23.662264 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Deleting subnet c6a2eeae-0fac-4586-be17-093ae2e28ec5 {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:51:23.665620 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:23.700597 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:23.740731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:23.798908 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:23.823807 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6a2eeae-0fac-4586-be17-093ae2e28ec5,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:23.832145 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:23.835575 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e2103a8e-2f85-41c8-a944-11f20dbb6e7e admin admin] 10.222.0.31 "DELETE /v2.0/subnets/c6a2eeae-0fac-4586-be17-093ae2e28ec5 HTTP/1.1" status: 204 len: 168 time: 0.2179396 Nov 15 17:51:23.837949 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 56896) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:23.908096 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.002347 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.022674 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3919dfc4-3e42-4144-97e7-2ccb5146f2a2']}} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.032561 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d') {'for_net_delete': True} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.032855 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c2c03eb5-8651-4f4e-bbb7-e7f1b266074d') {} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.042731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59181159'] for segment, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.058353 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.058845 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 56902) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.065774 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Releasing vlan 431 on physical network physnet1 to pool {{(pid=108141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:51:24.066399 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59170109'] for segment, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: Traceback (most recent call last): Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: timer() Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: cb(*args, **kw) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: return func(*args, **kwargs) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: self._notify() Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: self.callback(batched_events) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: event.method(event) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: return f(self, *a, **k) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._get(url).json() Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: return self.request(url, 'GET', **kwargs) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:51:24.068370 dv-cinder-788366-7-iscsi neutron-server[108141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:51:24.115838 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Deleting subnet 7424951c-80da-4659-9a6c-ca7b2ec6e17a {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:51:24.119298 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.130382 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.137511 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.141460 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] 10.222.0.31 "DELETE /v2.0/networks/3919dfc4-3e42-4144-97e7-2ccb5146f2a2 HTTP/1.1" status: 204 len: 168 time: 0.3025696 Nov 15 17:51:24.152091 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fcfa36a-0a2e-46e4-89fe-332b5621d462 admin admin] Pushing event deleted for resources: {'Network': ['ID=3919dfc4-3e42-4144-97e7-2ccb5146f2a2,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:24.163180 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.201154 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.252498 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.277112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7424951c-80da-4659-9a6c-ca7b2ec6e17a,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:24.281098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.284513 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b1e75221-d8ec-47f7-8c97-2a05f7a66f57 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/7424951c-80da-4659-9a6c-ca7b2ec6e17a HTTP/1.1" status: 204 len: 168 time: 0.2233703 Nov 15 17:51:24.287192 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 56906) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.339350 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 56908) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.358827 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.380821 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b82383ba-360b-4c66-b842-961b49dc55fc admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cdb494aa542c4eff8e62f9dd653bde82&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0401511 Nov 15 17:51:24.383346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 56910) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.435807 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.455935 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.457086 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.484558 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['840a23aa-77b8-4f10-9b9f-7b064a15ef6b']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.495179 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '87006e21-df9a-4769-925c-1d4d72189624') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.495683 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '87006e21-df9a-4769-925c-1d4d72189624') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:24.507330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.509554 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.512314 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.516400 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/742e6151-6dd5-4b0b-a0b5-305643083373 HTTP/1.1" status: 204 len: 168 time: 0.1295607 Nov 15 17:51:24.523229 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b946111-7c6a-4e74-8ff3-0c2708467738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=742e6151-6dd5-4b0b-a0b5-305643083373,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:24.525526 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.534402 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Releasing vlan 446 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:51:24.535105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:51:24.537414 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:51:24.589770 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e733a5ca-fafd-49b6-a28d-73b0e364e9c9 req-8a575554-e85e-43d3-a74f-a0d37b68c8d2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:24.591733 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e733a5ca-fafd-49b6-a28d-73b0e364e9c9 req-8a575554-e85e-43d3-a74f-a0d37b68c8d2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0514584 Nov 15 17:51:24.593923 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.600686 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.613260 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] 10.222.0.31 "DELETE /v2.0/networks/840a23aa-77b8-4f10-9b9f-7b064a15ef6b HTTP/1.1" status: 204 len: 168 time: 0.3249927 Nov 15 17:51:24.638897 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e088f94-9ab9-44b8-8c05-3f3add488d7a admin admin] Pushing event deleted for resources: {'Network': ['ID=840a23aa-77b8-4f10-9b9f-7b064a15ef6b,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:24.650251 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e733a5ca-fafd-49b6-a28d-73b0e364e9c9 req-302fcc16-b1d4-4112-acfb-358e4ad19183 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516970 Nov 15 17:51:24.863581 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 56930) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.905546 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ad44d568-cc3b-4206-bb28-0160a8eb30b7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=4f592f6fa5d14c7b91a773d7f8a2f295&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0407245 Nov 15 17:51:24.909310 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 56932) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:24.973778 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:24.997013 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.047841 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.050395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.054204 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ef9e1c0c-0ed0-4993-8ecb-6610248183a9 HTTP/1.1" status: 204 len: 168 time: 0.1413085 Nov 15 17:51:25.060297 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f5af4a-ce0c-4591-96d5-a84c75d2e3de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef9e1c0c-0ed0-4993-8ecb-6610248183a9,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:25.195924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 56948) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:25.374131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d96b92c0-0229-4f44-b494-6c1f7649dd11 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.460728 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d96b92c0-0229-4f44-b494-6c1f7649dd11 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.467381 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d96b92c0-0229-4f44-b494-6c1f7649dd11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.506490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d96b92c0-0229-4f44-b494-6c1f7649dd11 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a87481e39b9c4cc28f0f83101c6b8f97&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3091753 Nov 15 17:51:25.507542 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96b92c0-0229-4f44-b494-6c1f7649dd11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d68f068-5bc3-47ce-8803-45e612b90fdd,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:25.509369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 56966) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:25.564731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.586625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.637205 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.640429 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:25.644873 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/2d68f068-5bc3-47ce-8803-45e612b90fdd HTTP/1.1" status: 204 len: 168 time: 0.1343143 Nov 15 17:51:25.661103 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc44d83-f93a-4765-a7c0-afc9409b8182 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d68f068-5bc3-47ce-8803-45e612b90fdd,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:25.793469 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae0d3db-3c89-4554-b8e7-1444f58fd653 req-e778d742-ba16-4be0-84da-a3f488c10f21 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:25.797477 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4ae0d3db-3c89-4554-b8e7-1444f58fd653 req-e778d742-ba16-4be0-84da-a3f488c10f21 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0616090 Nov 15 17:51:25.859911 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4ae0d3db-3c89-4554-b8e7-1444f58fd653 req-f70a5150-cb46-4ffc-84d8-2e1130989735 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528624 Nov 15 17:51:26.040899 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8460be3-647a-48d8-a3d9-37b6f809d8b0 req-a854ce2e-c848-40a1-9291-a939653529ef tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:26.042639 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8460be3-647a-48d8-a3d9-37b6f809d8b0 req-a854ce2e-c848-40a1-9291-a939653529ef tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0587318 Nov 15 17:51:26.092900 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a8460be3-647a-48d8-a3d9-37b6f809d8b0 req-3c425b6a-d5cb-4687-9d60-298f59453640 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437777 Nov 15 17:51:26.880536 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6eb8cabb-711a-47ac-965c-82db4534f237 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:26.906956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 6eb8cabb-711a-47ac-965c-82db4534f237 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:26.907564 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 6eb8cabb-711a-47ac-965c-82db4534f237 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:27.014215 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e819cff2-a696-4bc5-9fee-bf01f10a6638 req-954ecee1-76d0-4e9d-86ad-c1476f7a8d7e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:27.015960 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e819cff2-a696-4bc5-9fee-bf01f10a6638 req-954ecee1-76d0-4e9d-86ad-c1476f7a8d7e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0534706 Nov 15 17:51:27.068325 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e819cff2-a696-4bc5-9fee-bf01f10a6638 req-e534e8cd-04f5-48b5-9e90-5bc77a8bd14d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452864 Nov 15 17:51:27.251291 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1c678b-66b1-48d6-9199-70dc8a0e2c35 req-5ed63950-ee3f-488e-b4dc-6f0d61dc1b96 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:27.252880 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5e1c678b-66b1-48d6-9199-70dc8a0e2c35 req-5ed63950-ee3f-488e-b4dc-6f0d61dc1b96 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0664537 Nov 15 17:51:27.305438 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5e1c678b-66b1-48d6-9199-70dc8a0e2c35 req-129cc0e1-ac57-4d69-b787-5f3035b6a288 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442410 Nov 15 17:51:28.194060 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895c0f8c-9675-4c89-adcf-b99adc6671f7 req-d0773abd-2555-4542-86fb-d8eca576ee3c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:28.195997 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-895c0f8c-9675-4c89-adcf-b99adc6671f7 req-d0773abd-2555-4542-86fb-d8eca576ee3c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0509841 Nov 15 17:51:28.248930 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-895c0f8c-9675-4c89-adcf-b99adc6671f7 req-1ee46db9-24e2-4077-a0d6-15cbc381f23f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453513 Nov 15 17:51:28.460084 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1bdd04-d070-485a-a3c2-4aaf77ae3ccf req-9c782f4a-adf0-4e79-9ded-b5b2a74bf2b2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:28.461604 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3b1bdd04-d070-485a-a3c2-4aaf77ae3ccf req-9c782f4a-adf0-4e79-9ded-b5b2a74bf2b2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0781682 Nov 15 17:51:28.514696 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3b1bdd04-d070-485a-a3c2-4aaf77ae3ccf req-2aa620ae-5560-4d85-8eed-dad8d92c890e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454652 Nov 15 17:51:28.671947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-5027bf97-abbf-42cf-aef0-1b25e19cf499 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:28.673441 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-5027bf97-abbf-42cf-aef0-1b25e19cf499 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 945 time: 0.0638738 Nov 15 17:51:28.769688 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Deleting port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:28.770148 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:28.867932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] For port 0e458b3e-0cc6-4756-a46f-7648dc4c8384, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e458b3e-0cc6-4756-a46f-7648dc4c8384,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:28.868648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:28.880792 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Calling delete_port for 0e458b3e-0cc6-4756-a46f-7648dc4c8384 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:29.014589 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:29.047404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Pushing event deleted for resources: {'Port': ['ID=0e458b3e-0cc6-4756-a46f-7648dc4c8384,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:29.086231 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] No DVR routers for this DVR port 0e458b3e-0cc6-4756-a46f-7648dc4c8384 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:29.088870 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:29.092311 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-23c2da59-9ae5-4a2a-87a9-9a3bd583e28c req-46d6c4b7-c642-4d65-b92a-369862b19272 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "DELETE /v2.0/ports/0e458b3e-0cc6-4756-a46f-7648dc4c8384 HTTP/1.1" status: 204 len: 173 time: 0.4117956 Nov 15 17:51:29.092754 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'name': 'network-vif-deleted', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:29.094999 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eba71dc6-a825-4b3d-9db1-699aa5b9e2e9" -d '{"events": [{"server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "name": "network-vif-deleted", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:29.131686 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df184641-95ad-4d9f-b527-1752ad2d690e x-openstack-request-id: req-df184641-95ad-4d9f-b527-1752ad2d690e {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:29.131995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a1bf57e-c715-445b-bbc3-df763d585e5f", "name": "network-vif-deleted", "tag": "0e458b3e-0cc6-4756-a46f-7648dc4c8384", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:29.132243 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-df184641-95ad-4d9f-b527-1752ad2d690e {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:29.132639 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a1bf57e-c715-445b-bbc3-df763d585e5f', 'name': 'network-vif-deleted', 'tag': '0e458b3e-0cc6-4756-a46f-7648dc4c8384', 'status': 'completed', 'code': 200} Nov 15 17:51:29.385966 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f33d6b-f03f-4149-ae4b-d0c33130e160 req-f6674622-a538-405b-b6b2-6aa4a9408a0e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:29.387422 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74f33d6b-f03f-4149-ae4b-d0c33130e160 req-f6674622-a538-405b-b6b2-6aa4a9408a0e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0568399 Nov 15 17:51:29.438416 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74f33d6b-f03f-4149-ae4b-d0c33130e160 req-d847256d-d776-4a52-9288-b1dbc3ebd8b5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444150 Nov 15 17:51:29.612757 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1022d5b5-abc3-4128-98ab-180d23babae9 req-b915ce43-f500-479c-9034-18d4ad7cf626 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.0260303 Nov 15 17:51:29.803204 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57164) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:29.915625 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0c83a424-0232-4cc3-ad26-e83f8ac16b7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:29.997853 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0c83a424-0232-4cc3-ad26-e83f8ac16b7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.003131 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0c83a424-0232-4cc3-ad26-e83f8ac16b7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.042085 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0c83a424-0232-4cc3-ad26-e83f8ac16b7b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=405b3fbeaf254684b8cb590616a83c68&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2377658 Nov 15 17:51:30.042930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c83a424-0232-4cc3-ad26-e83f8ac16b7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6441b03-e69d-447c-8393-f45894d533d5,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:30.045693 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57170) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:30.102062 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.122304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.172265 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.174812 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.175986 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/b6441b03-e69d-447c-8393-f45894d533d5 HTTP/1.1" status: 204 len: 168 time: 0.1289871 Nov 15 17:51:30.183574 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c21e8a5-feab-4310-9035-0cda4963cf9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6441b03-e69d-447c-8393-f45894d533d5,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:30.466411 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57178) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:30.480442 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-215e1b51-63cb-491c-905f-9014d97eebf0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.559359 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-215e1b51-63cb-491c-905f-9014d97eebf0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.563762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-215e1b51-63cb-491c-905f-9014d97eebf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.567466 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefc3d41-f718-4246-a199-8cdb2101fe1f req-338409fd-85c6-4c93-bd57-1996f4e2ded5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:30.569127 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aefc3d41-f718-4246-a199-8cdb2101fe1f req-338409fd-85c6-4c93-bd57-1996f4e2ded5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0560119 Nov 15 17:51:30.605842 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-215e1b51-63cb-491c-905f-9014d97eebf0 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b3c0106ac17443769f2d45ec17d32ece&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1358402 Nov 15 17:51:30.605842 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215e1b51-63cb-491c-905f-9014d97eebf0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d854367-09c5-4659-b27d-ad58beafa354,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:30.606157 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57182) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:30.639912 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aefc3d41-f718-4246-a199-8cdb2101fe1f req-83124db0-7f88-4152-8a64-bc9de4a58aaf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0642531 Nov 15 17:51:30.685025 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.716265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.739841 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ca48f6f5-3b60-4a09-8f30-17ab0b135618 req-5a8015ce-60aa-4ff5-94da-dd01098cea4e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.0406978 Nov 15 17:51:30.780587 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.783081 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.787399 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1d854367-09c5-4659-b27d-ad58beafa354 HTTP/1.1" status: 204 len: 168 time: 0.1765110 Nov 15 17:51:30.787576 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7fb9e259-691a-480d-b072-51f3b0ad6f56 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:30.795597 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443f2788-0164-4234-8566-380e910bdd6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d854367-09c5-4659-b27d-ad58beafa354,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:31.553199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['0e458b3e-0cc6-4756-a46f-7648dc4c8384', '83d5ff18-1a58-411f-945c-9a39c617ae50'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:31.798069 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9253ad37-a838-49be-801b-7b79439bd5a8 req-b0458173-3b70-4f2f-b040-93e6552322f5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:31.799447 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9253ad37-a838-49be-801b-7b79439bd5a8 req-b0458173-3b70-4f2f-b040-93e6552322f5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0602083 Nov 15 17:51:31.887546 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c42fc501-605c-428a-a184-3071c95492c9 req-16013118-2a5e-4d24-9e3c-8933a237c908 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a1bf57e-c715-445b-bbc3-df763d585e5f HTTP/1.1" status: 200 len: 210 time: 0.0378687 Nov 15 17:51:31.906171 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9253ad37-a838-49be-801b-7b79439bd5a8 req-93177b5d-61c4-4404-a2fc-f6f23b19cb73 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0930984 Nov 15 17:51:33.026542 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499988fa-e2e4-4c2e-b054-1c000d61b935 req-d4371390-5e03-4873-9c85-cebb7cf59b51 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:33.028274 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-499988fa-e2e4-4c2e-b054-1c000d61b935 req-d4371390-5e03-4873-9c85-cebb7cf59b51 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0543218 Nov 15 17:51:33.078813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-be02f157-1ef4-4611-8f16-5ea746451f3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:33.099549 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-499988fa-e2e4-4c2e-b054-1c000d61b935 req-ae79c8ef-04c1-46cc-ad7d-630c3098e1ff tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631948 Nov 15 17:51:33.226435 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3679f43-9773-42ce-8ccd-2ecfdbef1997 req-9fabbfd3-dbe6-428d-b79a-16578e763c2b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:33.227975 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f3679f43-9773-42ce-8ccd-2ecfdbef1997 req-9fabbfd3-dbe6-428d-b79a-16578e763c2b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0545793 Nov 15 17:51:33.277352 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f3679f43-9773-42ce-8ccd-2ecfdbef1997 req-340e6686-bba2-4e24-bc39-0d89a90a4070 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433671 Nov 15 17:51:33.881063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57344) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:34.000638 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b4746ee-f949-44a9-9e1c-fde38210e8ee admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.077738 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b4746ee-f949-44a9-9e1c-fde38210e8ee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.081837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6b4746ee-f949-44a9-9e1c-fde38210e8ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.122175 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6b4746ee-f949-44a9-9e1c-fde38210e8ee admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=bb913e074c0545058c75fbd758436c1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2400148 Nov 15 17:51:34.123160 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4746ee-f949-44a9-9e1c-fde38210e8ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1484dbbf-3d44-4ae5-b261-745a6e37ae8a,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:34.125440 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57350) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:34.173870 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.216962 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.259160 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5a943f-2447-458a-8245-9c972edd6d59 req-d62c8a8c-b705-40e1-8199-21139fe2588b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:34.260650 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2e5a943f-2447-458a-8245-9c972edd6d59 req-d62c8a8c-b705-40e1-8199-21139fe2588b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0878446 Nov 15 17:51:34.290513 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.293043 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.294106 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1484dbbf-3d44-4ae5-b261-745a6e37ae8a HTTP/1.1" status: 204 len: 168 time: 0.1677027 Nov 15 17:51:34.317199 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-251cdce6-e5a1-429e-b05f-bd6078e9dff6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1484dbbf-3d44-4ae5-b261-745a6e37ae8a,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:34.327604 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2e5a943f-2447-458a-8245-9c972edd6d59 req-38eb4bad-2d78-4ee3-9682-02ae2b5fe7de tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596213 Nov 15 17:51:34.467187 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.602130 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57360) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:34.616394 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.617376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d05fef7-be60-4e4e-bd87-25b3b7bfba64 req-a4164c3a-d007-4a74-b0b7-a765ba408b5e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:34.619255 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6d05fef7-be60-4e4e-bd87-25b3b7bfba64 req-a4164c3a-d007-4a74-b0b7-a765ba408b5e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.2646613 Nov 15 17:51:34.672446 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6d05fef7-be60-4e4e-bd87-25b3b7bfba64 req-c62e6a9b-0b3c-48e0-a1d9-f33ce1b426c4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472071 Nov 15 17:51:34.697029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.702430 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.738780 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8664c407-d88b-4ce8-a9a9-d115a71fe996,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:34.742512 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=48fcc43e87714f24b98f748f2ca614a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1392987 Nov 15 17:51:34.745657 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57362) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:34.749353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.749698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.750216 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.750369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.750747 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.751116 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.751463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.751871 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.752168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.752546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.752844 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.753184 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19635f8f-2fa7-48ae-adef-140ab1b94fec admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:34.797992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.818149 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.865164 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.867677 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:34.869244 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/8664c407-d88b-4ce8-a9a9-d115a71fe996 HTTP/1.1" status: 204 len: 168 time: 0.1224780 Nov 15 17:51:34.877039 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2d8cfb-6546-462d-a490-6a1ea9c000b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8664c407-d88b-4ce8-a9a9-d115a71fe996,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:35.464031 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18aa200a-0633-4493-b0ff-f4279c434913 req-77f40744-ada1-4e41-8e88-1e189b126b94 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:35.465444 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18aa200a-0633-4493-b0ff-f4279c434913 req-77f40744-ada1-4e41-8e88-1e189b126b94 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0592906 Nov 15 17:51:35.517030 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18aa200a-0633-4493-b0ff-f4279c434913 req-e2249ffb-6483-4fd8-aa96-042672cf9d3f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453870 Nov 15 17:51:35.568718 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:35.792046 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931c3834-e588-4dce-ab85-5d1a0f6a9e38 req-103f4b45-2c79-4f2a-8f87-6b5d46260f0e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:35.793400 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-931c3834-e588-4dce-ab85-5d1a0f6a9e38 req-103f4b45-2c79-4f2a-8f87-6b5d46260f0e tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0528109 Nov 15 17:51:35.842898 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-931c3834-e588-4dce-ab85-5d1a0f6a9e38 req-efbc0fba-6612-4ce5-ab78-587fbf921ba0 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429041 Nov 15 17:51:36.289369 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e458b3e-0cc6-4756-a46f-7648dc4c8384 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:36.309224 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 0e458b3e-0cc6-4756-a46f-7648dc4c8384 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:36.309564 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e458b3e-0cc6-4756-a46f-7648dc4c8384 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:36.659417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:36.678184 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524b5b38-b681-4c47-8bf6-c6eef1a48a2c req-5b1a35cb-0560-4284-a7ca-86d32c3333e5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:36.679668 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-524b5b38-b681-4c47-8bf6-c6eef1a48a2c req-5b1a35cb-0560-4284-a7ca-86d32c3333e5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0741103 Nov 15 17:51:36.726564 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-524b5b38-b681-4c47-8bf6-c6eef1a48a2c req-73652730-b34e-4a55-8ed7-8ea627acb60d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404582 Nov 15 17:51:36.968941 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8160de19-8205-4be0-aabc-913a7c86fc1d req-987dd9fc-0131-4b1d-8d78-c8ffba8f554d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:36.970438 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8160de19-8205-4be0-aabc-913a7c86fc1d req-987dd9fc-0131-4b1d-8d78-c8ffba8f554d tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0571420 Nov 15 17:51:37.024926 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8160de19-8205-4be0-aabc-913a7c86fc1d req-700032d3-7381-4d40-8b23-69ee01a5a153 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477998 Nov 15 17:51:37.853828 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba49e74b-18cf-496e-89ad-794cdea09007 req-20417eb5-1141-434a-b86e-8dc305be2885 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:37.855437 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ba49e74b-18cf-496e-89ad-794cdea09007 req-20417eb5-1141-434a-b86e-8dc305be2885 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0511875 Nov 15 17:51:37.913253 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ba49e74b-18cf-496e-89ad-794cdea09007 req-c529226e-eb15-4990-ba81-e4e32690fd82 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483158 Nov 15 17:51:38.156085 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ac3cf6-4041-4d0a-8a95-be22026326d0 req-d0ba709d-376f-4bbf-94d4-efffdf52e5fd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:38.157530 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e4ac3cf6-4041-4d0a-8a95-be22026326d0 req-d0ba709d-376f-4bbf-94d4-efffdf52e5fd tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0524135 Nov 15 17:51:38.205816 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e4ac3cf6-4041-4d0a-8a95-be22026326d0 req-aed7b37d-e2a6-4b2f-be00-0c1e2cf3accc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423284 Nov 15 17:51:38.787115 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:51:38.895548 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:38.908878 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:51:38.948502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:38.961982 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:51:38.982605 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:38.987390 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:39.032602 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38702165-509b-4cd5-969b-8f60ce185b03 req-425152f1-deac-434a-a22c-8bf44a0641be tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:39.034461 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-38702165-509b-4cd5-969b-8f60ce185b03 req-425152f1-deac-434a-a22c-8bf44a0641be tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0503507 Nov 15 17:51:39.036242 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=6']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:39.043744 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.044023 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.044324 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.044679 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.044984 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.045303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.045632 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.045963 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.046344 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.046672 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.046982 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.047435 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:39.082592 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-38702165-509b-4cd5-969b-8f60ce185b03 req-81f0f935-23ca-400c-a270-f776d676178a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419884 Nov 15 17:51:39.340930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed05da46-cfa8-4efb-bc3b-561232d0e772 req-7061d962-d755-4d51-b7f7-e1d2851d01aa tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:39.342290 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ed05da46-cfa8-4efb-bc3b-561232d0e772 req-7061d962-d755-4d51-b7f7-e1d2851d01aa tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0514481 Nov 15 17:51:39.402851 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ed05da46-cfa8-4efb-bc3b-561232d0e772 req-f2756778-2ec0-4ee2-909b-cc6d64b0dda5 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513613 Nov 15 17:51:40.203676 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291cf182-2e9a-4915-9b42-2f14fcdfba11 req-6ad0231f-d4b4-45d1-ab2c-308302eb9c00 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:40.205219 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-291cf182-2e9a-4915-9b42-2f14fcdfba11 req-6ad0231f-d4b4-45d1-ab2c-308302eb9c00 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0511467 Nov 15 17:51:40.259413 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-291cf182-2e9a-4915-9b42-2f14fcdfba11 req-761d5f20-f921-412f-877a-e76080f642c6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481873 Nov 15 17:51:40.519278 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849206a3-219d-4bb5-9abe-4e065ae18e2b req-a4e49eda-012a-4992-9449-90f67db9937f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:40.520782 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-849206a3-219d-4bb5-9abe-4e065ae18e2b req-a4e49eda-012a-4992-9449-90f67db9937f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0493140 Nov 15 17:51:40.578165 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-849206a3-219d-4bb5-9abe-4e065ae18e2b req-4f39c4c2-70d3-45fd-a253-93b98e174ad6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485961 Nov 15 17:51:41.009250 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['db874a84-aa99-4b23-9465-3c565bb54cf2'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:41.397860 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb81551f-72af-4e55-a04a-4f39e9a70151 req-de1d912c-909e-41c5-8e8a-30c107121875 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:41.400008 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eb81551f-72af-4e55-a04a-4f39e9a70151 req-de1d912c-909e-41c5-8e8a-30c107121875 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0562582 Nov 15 17:51:41.450648 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eb81551f-72af-4e55-a04a-4f39e9a70151 req-2f1eabc3-5b3c-4742-b819-a3ddc1025f55 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422812 Nov 15 17:51:41.695514 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1ed571-02a9-4e86-a58e-b40a42df14cc req-3154a48c-b55a-40aa-870d-8bcee37ad760 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:41.697072 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3b1ed571-02a9-4e86-a58e-b40a42df14cc req-3154a48c-b55a-40aa-870d-8bcee37ad760 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0496042 Nov 15 17:51:41.748814 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3b1ed571-02a9-4e86-a58e-b40a42df14cc req-dee380b0-9337-4791-8bda-8ebf5449cca2 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450370 Nov 15 17:51:42.571015 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223f6f2d-630c-4b07-8dab-454aa0dfcf7a req-be2a2b1c-2b61-4be3-b492-7b5e64df18d1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:42.572582 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-223f6f2d-630c-4b07-8dab-454aa0dfcf7a req-be2a2b1c-2b61-4be3-b492-7b5e64df18d1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0483949 Nov 15 17:51:42.624917 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-223f6f2d-630c-4b07-8dab-454aa0dfcf7a req-7aee555e-27ce-4589-91fd-497315f1593d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463367 Nov 15 17:51:42.876741 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89ae7d0-f046-4a45-bbae-f2f1d801480c req-d715ff18-40e4-4c9e-8a3a-8252101e0531 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:42.878209 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b89ae7d0-f046-4a45-bbae-f2f1d801480c req-d715ff18-40e4-4c9e-8a3a-8252101e0531 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0492294 Nov 15 17:51:42.927281 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b89ae7d0-f046-4a45-bbae-f2f1d801480c req-5e7344b3-e507-462e-9467-0485804fab5f tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428798 Nov 15 17:51:43.755195 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa63a7ba-ff42-4639-82c0-735779e207dd req-b3284d87-4a77-4fdd-873e-514fa5d51743 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:43.756705 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa63a7ba-ff42-4639-82c0-735779e207dd req-b3284d87-4a77-4fdd-873e-514fa5d51743 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0503306 Nov 15 17:51:43.812771 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa63a7ba-ff42-4639-82c0-735779e207dd req-e79ebe77-b3c7-4f09-8f1f-d9f2d49b813e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468018 Nov 15 17:51:44.059754 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e009f54b-b469-49e2-9821-aac2da4ac0e0 req-669cb30a-023c-4f32-942b-0c35a0b28ee4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:44.061330 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e009f54b-b469-49e2-9821-aac2da4ac0e0 req-669cb30a-023c-4f32-942b-0c35a0b28ee4 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0603590 Nov 15 17:51:44.108868 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e009f54b-b469-49e2-9821-aac2da4ac0e0 req-53f8bd55-7a24-4878-a0d9-692862846949 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416856 Nov 15 17:51:44.571527 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:51:44.631784 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port db874a84-aa99-4b23-9465-3c565bb54cf2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:51:44.632170 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:44.710543 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:44.733856 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:44.736112 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0ec1f76-b6b5-4f3e-a208-98329c88b3b5" -d '{"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:44.749844 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:44.756833 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:44.796042 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16b9a772-cd67-44b1-8e5c-455631eb9033 x-openstack-request-id: req-16b9a772-cd67-44b1-8e5c-455631eb9033 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:44.796212 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:44.796463 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-16b9a772-cd67-44b1-8e5c-455631eb9033 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:44.796874 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'code': 200} Nov 15 17:51:44.829114 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=7']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:44.941723 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9498cc8f-b168-41dc-bb87-19d97bf146d9 req-e3d33a82-a181-4d2f-8938-6068fb7f06b1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:44.943285 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9498cc8f-b168-41dc-bb87-19d97bf146d9 req-e3d33a82-a181-4d2f-8938-6068fb7f06b1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0509419 Nov 15 17:51:44.991184 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9498cc8f-b168-41dc-bb87-19d97bf146d9 req-5c726307-5d12-4854-b5f1-302a93d08ff9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417917 Nov 15 17:51:45.270084 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc513a51-efde-4b22-a64d-35557fcbd1e9 req-33725746-1f8c-419c-b717-f269c80a9647 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:45.272266 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bc513a51-efde-4b22-a64d-35557fcbd1e9 req-33725746-1f8c-419c-b717-f269c80a9647 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0907950 Nov 15 17:51:45.334411 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bc513a51-efde-4b22-a64d-35557fcbd1e9 req-ea73ea25-52d0-4a64-8094-008c151c2484 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547061 Nov 15 17:51:46.133430 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d544fd75-7846-41b6-8717-a29dcf0cee7c req-f44286ba-1e01-4af1-9e3a-220c507b9d1f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:46.135080 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d544fd75-7846-41b6-8717-a29dcf0cee7c req-f44286ba-1e01-4af1-9e3a-220c507b9d1f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0550623 Nov 15 17:51:46.190834 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d544fd75-7846-41b6-8717-a29dcf0cee7c req-1600da39-5955-44c2-8875-b1945e3a0969 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488386 Nov 15 17:51:46.470021 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55095e7d-502e-4158-abd9-5193386ba76e req-9a5fd38a-4554-4e28-835a-32c72626ef5b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:46.472300 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55095e7d-502e-4158-abd9-5193386ba76e req-9a5fd38a-4554-4e28-835a-32c72626ef5b tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0525124 Nov 15 17:51:46.530983 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55095e7d-502e-4158-abd9-5193386ba76e req-3fe930de-c797-4201-a8e4-bba43c7083b9 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518005 Nov 15 17:51:47.329363 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f5fdd8-47a3-4582-b27e-b7a58e982ddf req-6c8c7a47-f417-4162-931f-501502819429 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:47.330890 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29f5fdd8-47a3-4582-b27e-b7a58e982ddf req-6c8c7a47-f417-4162-931f-501502819429 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0522544 Nov 15 17:51:47.388286 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29f5fdd8-47a3-4582-b27e-b7a58e982ddf req-7946fc5b-bc24-44c0-89f9-fde5a8ee337d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507944 Nov 15 17:51:47.690852 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1de5fae-b2fb-4e9b-b742-e6f671ef7980 req-7db26f6f-a631-4da0-817f-9ad59b181410 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:47.692511 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c1de5fae-b2fb-4e9b-b742-e6f671ef7980 req-7db26f6f-a631-4da0-817f-9ad59b181410 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0610883 Nov 15 17:51:47.744247 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c1de5fae-b2fb-4e9b-b742-e6f671ef7980 req-aee8281e-25fe-4f87-898c-7f27e5c165bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450902 Nov 15 17:51:48.513371 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67bc0b6b-c55c-4467-9d53-def9d27a2e3a req-60f7f193-333c-4f53-9a41-1ee930abbf0d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:48.515951 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-67bc0b6b-c55c-4467-9d53-def9d27a2e3a req-60f7f193-333c-4f53-9a41-1ee930abbf0d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0548224 Nov 15 17:51:48.571345 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-67bc0b6b-c55c-4467-9d53-def9d27a2e3a req-b0ebe00d-612d-4fbe-94b5-4491ad1ea78a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484986 Nov 15 17:51:48.862340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebf1ed1-a8c8-4a03-9938-0259153bc26a req-6f9d7e4e-1dc3-49ee-86ce-2a021da1f7d6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:48.863954 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aebf1ed1-a8c8-4a03-9938-0259153bc26a req-6f9d7e4e-1dc3-49ee-86ce-2a021da1f7d6 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0492759 Nov 15 17:51:48.917462 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aebf1ed1-a8c8-4a03-9938-0259153bc26a req-40afa8bc-f9d1-4601-8db1-41fdba241880 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454683 Nov 15 17:51:49.047196 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:51:49.713295 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5c327a-ea37-4580-a611-b2e3e07f55a8 req-cc9457d0-7969-4905-a170-4a52eac651ea tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:49.721064 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5a5c327a-ea37-4580-a611-b2e3e07f55a8 req-cc9457d0-7969-4905-a170-4a52eac651ea tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0810537 Nov 15 17:51:49.789573 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5a5c327a-ea37-4580-a611-b2e3e07f55a8 req-0654b0ae-26da-4832-90b3-88f69539c294 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671656 Nov 15 17:51:50.045612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-965f0cf2-acee-4200-bbe8-f0c8173c9a30 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:50.048084 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-965f0cf2-acee-4200-bbe8-f0c8173c9a30 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0840044 Nov 15 17:51:50.080327 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017c7654-f098-4413-bb43-1eb80917bff9 req-0803ee77-c91a-4015-a1a3-fe3204088893 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:50.088205 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-017c7654-f098-4413-bb43-1eb80917bff9 req-0803ee77-c91a-4015-a1a3-fe3204088893 tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6115cd7-febb-40db-bed5-353604cca5d4 HTTP/1.1" status: 200 len: 946 time: 0.0787830 Nov 15 17:51:50.159836 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-017c7654-f098-4413-bb43-1eb80917bff9 req-95014feb-ca4a-45d5-bc7c-7a1e9d8abaad tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.31 "GET /v2.0/security-groups?id=4876c2de-52d0-4a8c-8e90-62cd58821014&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706174 Nov 15 17:51:50.175669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Deleting port 83d5ff18-1a58-411f-945c-9a39c617ae50 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:50.176382 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:50.278697 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] For port 83d5ff18-1a58-411f-945c-9a39c617ae50, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=83d5ff18-1a58-411f-945c-9a39c617ae50,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:50.279048 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:50.292140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Calling delete_port for 83d5ff18-1a58-411f-945c-9a39c617ae50 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:50.426804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:50.440681 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['83d5ff18-1a58-411f-945c-9a39c617ae50'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:51:50.455369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Pushing event deleted for resources: {'Port': ['ID=83d5ff18-1a58-411f-945c-9a39c617ae50,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:50.498274 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] No DVR routers for this DVR port 83d5ff18-1a58-411f-945c-9a39c617ae50 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:51:50.500699 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:50.503994 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3d0c4f35-e1d3-486f-a360-feeed1ac4112 req-1d1b0181-87c7-442e-8080-837555e3e8bc tempest-ServerRescueNegativeTestJSON-341588212 tempest-ServerRescueNegativeTestJSON-341588212-project] 10.222.0.48 "DELETE /v2.0/ports/83d5ff18-1a58-411f-945c-9a39c617ae50 HTTP/1.1" status: 204 len: 173 time: 0.4445047 Nov 15 17:51:50.504417 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'name': 'network-vif-deleted', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:50.506882 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5771194-9c23-4266-8f02-7e3cb71c62d3" -d '{"events": [{"server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "name": "network-vif-deleted", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:50.543762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d7d6e27-0427-431d-a926-0aaafe6d6736 x-openstack-request-id: req-9d7d6e27-0427-431d-a926-0aaafe6d6736 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:50.544050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6115cd7-febb-40db-bed5-353604cca5d4", "name": "network-vif-deleted", "tag": "83d5ff18-1a58-411f-945c-9a39c617ae50", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:50.544291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9d7d6e27-0427-431d-a926-0aaafe6d6736 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:50.544686 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6115cd7-febb-40db-bed5-353604cca5d4', 'name': 'network-vif-deleted', 'tag': '83d5ff18-1a58-411f-945c-9a39c617ae50', 'status': 'completed', 'code': 200} Nov 15 17:51:50.914106 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e471000-d270-47bf-a40c-8c5f9b85cffb req-28328b9f-7990-47de-b26b-896c5b7263da tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:50.915753 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e471000-d270-47bf-a40c-8c5f9b85cffb req-28328b9f-7990-47de-b26b-896c5b7263da tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0554626 Nov 15 17:51:50.970392 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e471000-d270-47bf-a40c-8c5f9b85cffb req-ae7f2dad-aa2c-4346-a292-d771bb6c9ed6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481606 Nov 15 17:51:51.225966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57682) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:51.738085 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.068190 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Deleting port dfc39e9f-8c1e-4337-980d-b53e78bac2f2 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:52.068827 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.141929 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dfa27c9-0be0-48f6-b127-f7999028512c req-03104e0e-64aa-4b0c-8c24-465556edd612 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:52.152273 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7dfa27c9-0be0-48f6-b127-f7999028512c req-03104e0e-64aa-4b0c-8c24-465556edd612 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0820513 Nov 15 17:51:52.212112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] For port dfc39e9f-8c1e-4337-980d-b53e78bac2f2, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,segment=NetworkSegment(b562ff7b-8aea-4e14-99e1-0c669a0cb625),segment_id=b562ff7b-8aea-4e14-99e1-0c669a0cb625)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:52.212471 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.240047 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Calling delete_port for dfc39e9f-8c1e-4337-980d-b53e78bac2f2 owned by network:router_interface {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:52.248714 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7dfa27c9-0be0-48f6-b127-f7999028512c req-4acff98c-c52d-458c-bf1a-fd758c8d78b6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0951786 Nov 15 17:51:52.335861 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.756807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.785092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Pushing event deleted for resources: {'Port': ['ID=dfc39e9f-8c1e-4337-980d-b53e78bac2f2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:52.824079 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57718) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:52.968024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:52.980217 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.044423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.052203 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.096015 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c49f0cd797d1416d9d2575fdf951a0d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2703784 Nov 15 17:51:53.097628 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c1a2bd1-f39e-4393-aa95-b3d398ea2f48,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:53.098669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57722) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:53.107513 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.108260 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.108690 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.109277 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.109823 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.110358 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.110866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.111379 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.111923 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.112410 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.112875 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.113346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8ca94f8-12ab-422d-9dbe-4912cd4bfd2f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:51:53.229015 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.263062 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.311926 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:51:53.364958 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.367638 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.369186 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4c1a2bd1-f39e-4393-aa95-b3d398ea2f48 HTTP/1.1" status: 204 len: 168 time: 0.2683182 Nov 15 17:51:53.408416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b722d1e-9d8c-451a-8ee0-198a2390864f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c1a2bd1-f39e-4393-aa95-b3d398ea2f48,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:53.422257 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b8d2b1-08a3-4e82-a5d5-9e06830e1ce6 req-82277b79-8370-4523-9052-aff1ace3ca56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:53.423904 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75b8d2b1-08a3-4e82-a5d5-9e06830e1ce6 req-82277b79-8370-4523-9052-aff1ace3ca56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0783226 Nov 15 17:51:53.483677 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:51:53.489934 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-75b8d2b1-08a3-4e82-a5d5-9e06830e1ce6 req-4ce8ab99-740b-49b8-89c7-6ea0a95400be tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0587897 Nov 15 17:51:53.498525 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Sync routers for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:51:53.510552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57732) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:53.511167 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-79c6a843-2b2d-461c-8443-c4bd9d669f01 admin admin] 10.222.0.31 "PUT /v2.0/routers/bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2838879 Nov 15 17:51:53.526323 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:51:53.527489 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:51:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:53.678736 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.720747 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:51:53.867536 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.931520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Deleting port b804f9d3-4385-4863-8301-b631ae7123e4 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:51:53.932116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:53.946320 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:51:52Z', 'revision_number': 5, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port': {'id': 'b804f9d3-4385-4863-8301-b631ae7123e4', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:50:b9:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:53.974372 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Checking router: bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:51:53.986482 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Routers {'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:51:53.987082 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:51:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:54.024432 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] For port b804f9d3-4385-4863-8301-b631ae7123e4, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b804f9d3-4385-4863-8301-b631ae7123e4,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:54.025391 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.046783 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Calling delete_port for b804f9d3-4385-4863-8301-b631ae7123e4 owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:51:54.189973 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] Set router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:51:54.256121 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:51:53Z', 'revision_number': 6, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:54.285984 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36da4c8f-6026-4c0d-b16b-82b384283473 None None] The sync data for ids ['bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360'] in dv-cinder-788366-7-iscsi is: [{'id': 'bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360', 'name': 'tempest-ServerRescueNegativeTestJSON-1475591363-router', 'tenant_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:11Z', 'updated_at': '2021-11-15T17:51:53Z', 'revision_number': 6, 'project_id': 'ea39cfbc451d47108eac0fac5c2f4873', 'gw_port_host': None}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:51:54.302347 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.340534 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Pushing event deleted for resources: {'Port': ['ID=b804f9d3-4385-4863-8301-b631ae7123e4,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:54.398704 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.512054 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.514244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.610186 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.610617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Fanout notify agent at l3_agent the message router_deleted on router bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:51:54.624184 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.625335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-8627f645-1f1b-4ef0-b9ef-705dc3cb2a1c admin admin] 10.222.0.31 "DELETE /v2.0/routers/bbc005d4-6f5a-4c4c-8bbc-61bde4b6b360 HTTP/1.1" status: 204 len: 168 time: 1.1134100 Nov 15 17:51:54.628078 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57744) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:54.663378 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e246d1-d65d-41ce-a9e6-5588f48e2273 req-2cd71ec5-efcc-4cef-a850-8c42b1be4a0a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:54.669311 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34e246d1-d65d-41ce-a9e6-5588f48e2273 req-2cd71ec5-efcc-4cef-a850-8c42b1be4a0a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0917227 Nov 15 17:51:54.689731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Deleting subnet 9b912b7e-3193-418b-9139-60018a571278 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:51:54.699962 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.725746 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34e246d1-d65d-41ce-a9e6-5588f48e2273 req-68843593-fab8-4361-951b-10b6e179fe83 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537205 Nov 15 17:51:54.753247 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.828226 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.896524 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.923860 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9b912b7e-3193-418b-9139-60018a571278,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:54.928503 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:54.934337 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-3c487b73-45ff-4e5c-bb3c-c5b0124af334 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/9b912b7e-3193-418b-9139-60018a571278 HTTP/1.1" status: 204 len: 168 time: 0.3017178 Nov 15 17:51:54.936955 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 57748) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:55.007653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.093008 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.112820 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f25d23f6-7f59-4624-979f-a398984b16c9']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:55.122493 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b562ff7b-8aea-4e14-99e1-0c669a0cb625') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:55.122786 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b562ff7b-8aea-4e14-99e1-0c669a0cb625') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:51:55.138559 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.157210 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.166378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Releasing vlan 444 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:51:55.166776 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:51:55.168894 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:51:55.244029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.249621 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.252848 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] 10.222.0.31 "DELETE /v2.0/networks/f25d23f6-7f59-4624-979f-a398984b16c9 HTTP/1.1" status: 204 len: 168 time: 0.3149774 Nov 15 17:51:55.266576 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616ef0ae-f810-425c-9a2c-20f8548ff773 admin admin] Pushing event deleted for resources: {'Network': ['ID=f25d23f6-7f59-4624-979f-a398984b16c9,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:55.429458 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dfc39e9f-8c1e-4337-980d-b53e78bac2f2 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:55.454602 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: dfc39e9f-8c1e-4337-980d-b53e78bac2f2 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:55.455179 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dfc39e9f-8c1e-4337-980d-b53e78bac2f2 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:55.455805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b804f9d3-4385-4863-8301-b631ae7123e4 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:55.460932 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57760) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:55.481688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: b804f9d3-4385-4863-8301-b631ae7123e4 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:55.482024 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b804f9d3-4385-4863-8301-b631ae7123e4 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:55.512421 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-57becfc5-4af4-4c2b-809a-c0059d8e4776 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ea39cfbc451d47108eac0fac5c2f4873&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0460975 Nov 15 17:51:55.513605 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 57762) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:51:55.558316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.578045 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.634062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.636909 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:55.638069 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4876c2de-52d0-4a8c-8e90-62cd58821014 HTTP/1.1" status: 204 len: 168 time: 0.1238172 Nov 15 17:51:55.645718 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32152f35-8bbc-467f-bfc8-ee8183d20fec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4876c2de-52d0-4a8c-8e90-62cd58821014,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:51:55.663880 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 83d5ff18-1a58-411f-945c-9a39c617ae50 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:55.684580 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 83d5ff18-1a58-411f-945c-9a39c617ae50 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:51:55.684864 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 83d5ff18-1a58-411f-945c-9a39c617ae50 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:51:55.891992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e21822e7-aead-4489-8043-6f42e01e8a35 req-14727e93-5578-463f-a6f1-444c9b523bdd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:55.893465 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e21822e7-aead-4489-8043-6f42e01e8a35 req-14727e93-5578-463f-a6f1-444c9b523bdd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0541308 Nov 15 17:51:55.942890 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e21822e7-aead-4489-8043-6f42e01e8a35 req-f68fc23c-f41a-49b2-8ac8-779affc77d8e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430844 Nov 15 17:51:57.068226 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-defff2cc-25d8-4264-81e6-ff0fcac7daaa req-0e39b0a1-04ca-4328-bd37-96da40fcd9af tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:57.069696 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-defff2cc-25d8-4264-81e6-ff0fcac7daaa req-0e39b0a1-04ca-4328-bd37-96da40fcd9af tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0491145 Nov 15 17:51:57.117168 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-defff2cc-25d8-4264-81e6-ff0fcac7daaa req-4e1336c0-7182-479e-b87f-ec5204f6cf57 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410826 Nov 15 17:51:58.252966 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17782f15-0b3b-45e4-a169-1d6df0ce66bf req-dfb5d317-e1cf-4c65-8a31-5be3385a4f1f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:58.254459 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-17782f15-0b3b-45e4-a169-1d6df0ce66bf req-dfb5d317-e1cf-4c65-8a31-5be3385a4f1f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0602877 Nov 15 17:51:58.313505 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-17782f15-0b3b-45e4-a169-1d6df0ce66bf req-d9a4696f-f8ae-4f0d-9c68-cd1e7b5dc689 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478067 Nov 15 17:51:59.154395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-4b66e417-f146-4704-8d95-2714502e73ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:59.155962 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-4b66e417-f146-4704-8d95-2714502e73ab service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1098 time: 0.0425644 Nov 15 17:51:59.264779 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-9492b082-747e-4581-b88a-67b324ca25ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:59.266197 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-9492b082-747e-4581-b88a-67b324ca25ad service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.1008220 Nov 15 17:51:59.345995 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-734749fd-0386-4de0-a237-2e8377d14841 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 1001 time: 0.0716987 Nov 15 17:51:59.417733 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-6a143b92-c831-4150-bf7f-1e8c1c3470f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:59.419627 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-6a143b92-c831-4150-bf7f-1e8c1c3470f1 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0663109 Nov 15 17:51:59.459649 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-412a222d-b530-46f0-9eb0-f44419b16051 req-78fce01c-1ef9-40e1-b78a-8aa655a4d141 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:59.467048 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-412a222d-b530-46f0-9eb0-f44419b16051 req-78fce01c-1ef9-40e1-b78a-8aa655a4d141 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 945 time: 0.0621862 Nov 15 17:51:59.475881 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-7bd97cd3-94f6-421a-be28-75a50dec900a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:51:59.477401 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-7bd97cd3-94f6-421a-be28-75a50dec900a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0487480 Nov 15 17:51:59.511795 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-412a222d-b530-46f0-9eb0-f44419b16051 req-0109a71f-dade-4998-a9ef-f7ca6565c9c2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438275 Nov 15 17:51:59.572662 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-3347c71c-7f34-4ce4-86ee-b79bb8f4d52e service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858006 Nov 15 17:51:59.679764 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5d44a360-c0bb-4a38-a14f-cb86136e60c3 req-c3b94252-419b-4f92-911b-c98cbb1cb152 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0985610 Nov 15 17:51:59.701954 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:51:59.784281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:59.813666 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:51:59.815937 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9392c0d5-cea8-4ad8-b89e-7141e026c1ea" -d '{"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-unplugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:51:59.829181 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:51:59.834487 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:51:59.860549 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 15 Nov 2021 17:51:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc65f8eb-8f83-4c82-aabc-4d75ab60d272 x-openstack-request-id: req-bc65f8eb-8f83-4c82-aabc-4d75ab60d272 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:51:59.860836 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-unplugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:51:59.861129 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-bc65f8eb-8f83-4c82-aabc-4d75ab60d272 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:51:59.861599 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'code': 200} Nov 15 17:51:59.886487 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=8']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:00.637520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b33da34-c76c-44a7-b772-842f71fb2244 req-0c13c081-4fa7-4fc7-8eca-112c04a52a85 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:00.638971 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b33da34-c76c-44a7-b772-842f71fb2244 req-0c13c081-4fa7-4fc7-8eca-112c04a52a85 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0480230 Nov 15 17:52:00.686006 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b33da34-c76c-44a7-b772-842f71fb2244 req-7954aeff-7c0f-40d5-8ebb-9db4cc647085 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409567 Nov 15 17:52:00.788581 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-781a88fb-ff16-45ff-8db9-ec2fc48894c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:01.813686 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f39bcab5-59d5-4ba4-9f48-3db31d8de5f7 req-72dc201a-f3da-4539-aaab-5f0df320af5c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:01.815159 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f39bcab5-59d5-4ba4-9f48-3db31d8de5f7 req-72dc201a-f3da-4539-aaab-5f0df320af5c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0540102 Nov 15 17:52:01.864869 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f39bcab5-59d5-4ba4-9f48-3db31d8de5f7 req-6bdd1165-b292-4136-87a5-e02ab947a963 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431211 Nov 15 17:52:02.996009 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8596fc3-2ba8-48d6-9471-694f56f8359f req-a5848b96-e2ee-486d-bf7f-f08679f54bcc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:02.997488 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8596fc3-2ba8-48d6-9471-694f56f8359f req-a5848b96-e2ee-486d-bf7f-f08679f54bcc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0506752 Nov 15 17:52:03.045066 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b8596fc3-2ba8-48d6-9471-694f56f8359f req-b35997cd-64df-4512-a737-26bb05c65543 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416431 Nov 15 17:52:03.073571 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bdf06ffa-5957-4294-b243-c61f1b53c4ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:04.182297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e894c402-d233-4606-927f-1aa885b6477b req-78121877-3c21-4e67-aab6-9eabe717536e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:04.183806 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e894c402-d233-4606-927f-1aa885b6477b req-78121877-3c21-4e67-aab6-9eabe717536e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0532432 Nov 15 17:52:04.233895 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e894c402-d233-4606-927f-1aa885b6477b req-b46f2ba3-b9ed-4394-b94d-074f7ebf17fd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439405 Nov 15 17:52:04.463108 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:05.363759 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420ac285-f0b2-4db3-a870-c33bd34565d8 req-06fba724-2501-4e80-adc0-07623ea3dee3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:05.365380 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-420ac285-f0b2-4db3-a870-c33bd34565d8 req-06fba724-2501-4e80-adc0-07623ea3dee3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0565474 Nov 15 17:52:05.414099 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-420ac285-f0b2-4db3-a870-c33bd34565d8 req-c83dab06-bf0b-47d0-9e3c-9a4583f8c582 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420322 Nov 15 17:52:05.568954 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:05.934934 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [req-67568dee-2623-486c-afc1-1d5b39316b1d req-89f29d88-7a24-4e9e-ab7c-d4db71bd7282 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:52:05.936142 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-67568dee-2623-486c-afc1-1d5b39316b1d req-89f29d88-7a24-4e9e-ab7c-d4db71bd7282 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0083127 Nov 15 17:52:06.088408 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145b2589-47f5-4d01-8c7e-a591d1525c02 req-075ef23a-023e-45cd-b93e-19bfb5af362e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:06.090045 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-145b2589-47f5-4d01-8c7e-a591d1525c02 req-075ef23a-023e-45cd-b93e-19bfb5af362e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0487325 Nov 15 17:52:06.143501 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-145b2589-47f5-4d01-8c7e-a591d1525c02 req-2fedf0b0-694d-4fe8-9516-0e06b6d70c19 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447352 Nov 15 17:52:06.491806 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58016) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:06.577846 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-35f4d964-5817-4205-8633-989f69952ee3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0842333 Nov 15 17:52:06.586945 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-8e3448d7-c36b-4ad8-9008-fa91486cc9f3 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:52:06.588024 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-8e3448d7-c36b-4ad8-9008-fa91486cc9f3 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053711 Nov 15 17:52:06.672596 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:07.276462 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fed1d8d-567d-42a5-8465-d9a6f7fd99ca req-cd8fa3fc-2ce2-4b49-afa3-fda28176ac1a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:07.277919 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fed1d8d-567d-42a5-8465-d9a6f7fd99ca req-cd8fa3fc-2ce2-4b49-afa3-fda28176ac1a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0526333 Nov 15 17:52:07.327462 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fed1d8d-567d-42a5-8465-d9a6f7fd99ca req-08e54bd8-99f1-4b9e-83bd-652755126c27 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432746 Nov 15 17:52:08.466924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0ea826-b236-4b16-b7a1-fd4ca9e94e0f req-fa9cb582-e0f0-4516-9ea5-e9195c6a3dd8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:08.468453 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6b0ea826-b236-4b16-b7a1-fd4ca9e94e0f req-fa9cb582-e0f0-4516-9ea5-e9195c6a3dd8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0517755 Nov 15 17:52:08.486951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:52:08.519309 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6b0ea826-b236-4b16-b7a1-fd4ca9e94e0f req-0e81eac7-a593-4154-ae92-5403a759ca86 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448647 Nov 15 17:52:09.645109 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801de66c-1395-4531-ab4d-0ca25816912f req-63336126-a340-465a-8244-ab309206a569 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:09.646597 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-801de66c-1395-4531-ab4d-0ca25816912f req-63336126-a340-465a-8244-ab309206a569 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0525012 Nov 15 17:52:09.898083 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-801de66c-1395-4531-ab4d-0ca25816912f req-34eca7dc-a19c-4661-8e18-a65dcd9900a5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2447972 Nov 15 17:52:11.039474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e734ac7-e686-4574-89cd-3ffeb4a2376a req-6c7963c5-8eee-4b36-a5d6-cce5872c90e0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:11.041041 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e734ac7-e686-4574-89cd-3ffeb4a2376a req-6c7963c5-8eee-4b36-a5d6-cce5872c90e0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0533116 Nov 15 17:52:11.089108 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7e734ac7-e686-4574-89cd-3ffeb4a2376a req-49f78f04-b246-4ba4-bd50-5aa275f744fc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417409 Nov 15 17:52:12.226645 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9d06d8-fd44-47ca-b359-13dc71b19b11 req-1d256dc5-3d4c-40e5-a693-2e732e3e1d0c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:12.228271 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0e9d06d8-fd44-47ca-b359-13dc71b19b11 req-1d256dc5-3d4c-40e5-a693-2e732e3e1d0c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0553124 Nov 15 17:52:12.278669 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0e9d06d8-fd44-47ca-b359-13dc71b19b11 req-df209a29-2f35-4e10-80fb-55a62d21e07c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442181 Nov 15 17:52:13.411893 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109ddf40-2ff0-4539-9d3b-d0a99b282a2c req-be141144-4246-4159-b4e6-f03d07b33686 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:13.413448 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-109ddf40-2ff0-4539-9d3b-d0a99b282a2c req-be141144-4246-4159-b4e6-f03d07b33686 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0530832 Nov 15 17:52:13.460230 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-109ddf40-2ff0-4539-9d3b-d0a99b282a2c req-afced661-8846-47e9-9d21-58cc3df7ca43 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405371 Nov 15 17:52:14.258001 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-251c62c8-e01c-4ed0-b6da-dbb0e04b7267 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.259593 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-251c62c8-e01c-4ed0-b6da-dbb0e04b7267 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 1096 time: 0.0808821 Nov 15 17:52:14.330446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-7f1b8f11-ab23-467f-a1d7-37d211dc7166 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.332021 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-7f1b8f11-ab23-467f-a1d7-37d211dc7166 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1096 time: 0.0459428 Nov 15 17:52:14.439686 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-d430c145-64e2-4516-bdf8-c3b766e18a8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.441207 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-d430c145-64e2-4516-bdf8-c3b766e18a8d service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.0967474 Nov 15 17:52:14.531070 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-b1fac5d1-1719-49c6-af0c-b8a0d0768bc0 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 999 time: 0.0775590 Nov 15 17:52:14.582090 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-317904cb-494c-45a9-99e7-7fa643e8f430 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.583753 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-317904cb-494c-45a9-99e7-7fa643e8f430 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0466819 Nov 15 17:52:14.599329 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f432de1b-11ed-43f0-a34e-a7e56a89aae1 req-f5d0736a-07b7-4e17-8e90-38f19339cc2a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.600956 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f432de1b-11ed-43f0-a34e-a7e56a89aae1 req-f5d0736a-07b7-4e17-8e90-38f19339cc2a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0512497 Nov 15 17:52:14.635068 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-24a72558-4de4-44ae-8968-4bfbc96e8d00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:14.636772 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-24a72558-4de4-44ae-8968-4bfbc96e8d00 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0446925 Nov 15 17:52:14.659024 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f432de1b-11ed-43f0-a34e-a7e56a89aae1 req-596a0cb0-c090-4221-9784-3cf0cd43ba35 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517490 Nov 15 17:52:14.741666 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-3907922f-6bca-4138-9ceb-c40a4fb236b2 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0968494 Nov 15 17:52:14.835320 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-86fc8fe5-7df6-4a54-be8e-c98dc101a708 req-d5e7c583-8e0e-47f7-9116-606cfd56f97e service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850971 Nov 15 17:52:14.975509 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58160) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:15.088056 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-aea1ec4b-52d8-4e48-a090-bc84b8c8c330 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.166506 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-aea1ec4b-52d8-4e48-a090-bc84b8c8c330 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.171635 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-aea1ec4b-52d8-4e48-a090-bc84b8c8c330 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.209808 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-aea1ec4b-52d8-4e48-a090-bc84b8c8c330 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d361bdad706643e5be7fdab086718a30&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2330928 Nov 15 17:52:15.211888 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea1ec4b-52d8-4e48-a090-bc84b8c8c330 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=235e8427-476a-416f-8f83-ad802b9b6b3d,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:15.212674 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58180) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:15.268400 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.323506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.381553 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.386550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.388883 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/235e8427-476a-416f-8f83-ad802b9b6b3d HTTP/1.1" status: 204 len: 168 time: 0.1750209 Nov 15 17:52:15.402419 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a34d2d-55a1-4c4a-8d26-a4907e0742a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=235e8427-476a-416f-8f83-ad802b9b6b3d,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:15.829910 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde5e599-b302-4d51-b717-bc9800a6491d req-e7547827-8bbd-4fd9-87f9-709ec110eb30 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:15.855747 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cde5e599-b302-4d51-b717-bc9800a6491d req-e7547827-8bbd-4fd9-87f9-709ec110eb30 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0794315 Nov 15 17:52:15.859986 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58200) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:15.883202 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-498b8b2f-a4c5-4b66-90e3-0a3a12da2f8d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:15.945386 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cde5e599-b302-4d51-b717-bc9800a6491d req-80d6a2e4-2980-4e64-b237-f3a19f463d1e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785544 Nov 15 17:52:15.999833 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-498b8b2f-a4c5-4b66-90e3-0a3a12da2f8d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.005514 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-498b8b2f-a4c5-4b66-90e3-0a3a12da2f8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.045120 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-498b8b2f-a4c5-4b66-90e3-0a3a12da2f8d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=dc800ed37381419bbfbb77cb26e71964&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1840053 Nov 15 17:52:16.045819 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-498b8b2f-a4c5-4b66-90e3-0a3a12da2f8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5e68e9c-1711-4110-80ae-bb6709f993a7,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:16.048624 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58204) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:16.115492 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.139898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.196288 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.199729 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.199982 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e5e68e9c-1711-4110-80ae-bb6709f993a7 HTTP/1.1" status: 204 len: 168 time: 0.1498239 Nov 15 17:52:16.208154 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c6193e-76d1-4d59-a6d4-11ed3e67baf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5e68e9c-1711-4110-80ae-bb6709f993a7,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:16.581147 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58216) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:16.595784 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-de6635e0-0987-4168-948c-6d636ee23995 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.641781 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58218) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:16.679906 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-de6635e0-0987-4168-948c-6d636ee23995 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.687177 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-de6635e0-0987-4168-948c-6d636ee23995 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.731207 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58222) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:16.732245 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-de6635e0-0987-4168-948c-6d636ee23995 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b26dbde3dc564b92a63e80410e8aa514&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1495869 Nov 15 17:52:16.738385 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6635e0-0987-4168-948c-6d636ee23995 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbfe8646-4db0-41d4-b48f-e96390742274,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:16.806019 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.828242 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.850301 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-af79c73d-fc11-4721-9114-a2708cda3371 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.910198 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.913173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:16.917648 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fbfe8646-4db0-41d4-b48f-e96390742274 HTTP/1.1" status: 204 len: 168 time: 0.1823764 Nov 15 17:52:16.949405 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7f46c9-8e64-49ae-a308-4134f334c925 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbfe8646-4db0-41d4-b48f-e96390742274,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:16.998564 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-af79c73d-fc11-4721-9114-a2708cda3371 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.005442 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-af79c73d-fc11-4721-9114-a2708cda3371 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.055045 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58232) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:17.055564 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-af79c73d-fc11-4721-9114-a2708cda3371 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=3e9a47b685b64ba3bb829368d7687ec2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4117548 Nov 15 17:52:17.062758 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af79c73d-fc11-4721-9114-a2708cda3371 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5d87801-627e-42a0-918b-df71bef809da,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:17.212920 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.239030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abd3c55-3e46-41ba-bed5-70f801b18c97 req-10f276a0-fcd6-4d20-a476-2f00649022a9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:17.240775 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4abd3c55-3e46-41ba-bed5-70f801b18c97 req-10f276a0-fcd6-4d20-a476-2f00649022a9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0971286 Nov 15 17:52:17.255735 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.320797 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4abd3c55-3e46-41ba-bed5-70f801b18c97 req-53a774eb-2607-494c-85cf-cf7b8e49700b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0702035 Nov 15 17:52:17.346751 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.351172 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.353648 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f5d87801-627e-42a0-918b-df71bef809da HTTP/1.1" status: 204 len: 168 time: 0.2965605 Nov 15 17:52:17.364627 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f5f561-0045-4e8e-ad70-d18698371c74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5d87801-627e-42a0-918b-df71bef809da,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:17.752464 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58256) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:17.766903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ce6f5cf0-d11e-46d7-a646-8bf53e9caca6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.851555 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ce6f5cf0-d11e-46d7-a646-8bf53e9caca6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.856567 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ce6f5cf0-d11e-46d7-a646-8bf53e9caca6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.901795 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ce6f5cf0-d11e-46d7-a646-8bf53e9caca6 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6206b6d75d4c44acb2784ac8f4c38679&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1465433 Nov 15 17:52:17.902520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6f5cf0-d11e-46d7-a646-8bf53e9caca6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60cb40d8-1a9f-4442-861c-1e8225d62a9b,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:17.903250 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58262) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:17.958975 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:17.986742 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:18.049691 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:18.053945 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:18.055177 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/60cb40d8-1a9f-4442-861c-1e8225d62a9b HTTP/1.1" status: 204 len: 168 time: 0.1507618 Nov 15 17:52:18.068906 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c0b822-b5fc-49ee-b3df-5a45e2691671 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60cb40d8-1a9f-4442-861c-1e8225d62a9b,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:18.481665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331bedd5-828b-422c-9aef-d45880a0a8f2 req-b4b97b9a-8c16-4bda-800b-344739bbeb3b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:18.490446 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-331bedd5-828b-422c-9aef-d45880a0a8f2 req-b4b97b9a-8c16-4bda-800b-344739bbeb3b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0676444 Nov 15 17:52:18.591898 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-331bedd5-828b-422c-9aef-d45880a0a8f2 req-511a1c70-79cc-4eef-b2dd-76f0b8114d42 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0978389 Nov 15 17:52:19.739501 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58338) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:19.770861 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a916b876-4168-430d-8746-91e190db801c req-110e55d4-19a3-4c4a-bbe3-27840be303c7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:19.779149 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a916b876-4168-430d-8746-91e190db801c req-110e55d4-19a3-4c4a-bbe3-27840be303c7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0916564 Nov 15 17:52:19.850308 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a916b876-4168-430d-8746-91e190db801c req-24e05443-7f88-4c7f-a6a7-087774c4aa19 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689073 Nov 15 17:52:19.940392 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eebd024a-62e6-469a-a4b8-943493faa8b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.091139 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eebd024a-62e6-469a-a4b8-943493faa8b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.114418 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eebd024a-62e6-469a-a4b8-943493faa8b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.222434 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58364) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:20.223011 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-eebd024a-62e6-469a-a4b8-943493faa8b3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9db00c87cd114fa4af4a1c6125a685fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4811740 Nov 15 17:52:20.224052 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eebd024a-62e6-469a-a4b8-943493faa8b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17255d48-ba00-4e35-a621-bd2bc102637a,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:20.324291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.352557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.418937 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.427481 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:20.429250 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/17255d48-ba00-4e35-a621-bd2bc102637a HTTP/1.1" status: 204 len: 168 time: 0.2048664 Nov 15 17:52:20.440470 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2b5804-5c03-4743-a3bd-5a97e82b896f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17255d48-ba00-4e35-a621-bd2bc102637a,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:20.990887 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fa7572-6782-4341-810d-3b0fc8e4bd3e req-3877c4ef-e49a-4e27-8d54-a2c265982dbd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:20.994171 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68fa7572-6782-4341-810d-3b0fc8e4bd3e req-3877c4ef-e49a-4e27-8d54-a2c265982dbd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0704226 Nov 15 17:52:21.059481 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68fa7572-6782-4341-810d-3b0fc8e4bd3e req-60202f62-f67e-417c-b85d-15db7e36e3d9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588520 Nov 15 17:52:22.193676 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82e4b37-486e-4550-ba91-1466dd745000 req-65845561-29be-4b57-ba2a-96f56776c109 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:22.195289 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e82e4b37-486e-4550-ba91-1466dd745000 req-65845561-29be-4b57-ba2a-96f56776c109 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0595512 Nov 15 17:52:22.247879 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e82e4b37-486e-4550-ba91-1466dd745000 req-0efe3f2c-0ec1-4c97-8600-423a4ea45583 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464957 Nov 15 17:52:22.341687 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:23.383612 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8f0690-6b75-4164-b9d2-53340d811fcf req-3f617efa-fd73-4e5d-982d-91ac477372a6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:23.385275 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f8f0690-6b75-4164-b9d2-53340d811fcf req-3f617efa-fd73-4e5d-982d-91ac477372a6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0584009 Nov 15 17:52:23.460476 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f8f0690-6b75-4164-b9d2-53340d811fcf req-c36c45fb-4b53-42ad-86b2-4d3006bdedd1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643680 Nov 15 17:52:23.618998 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58442) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:23.731988 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6b67670b-341b-4c1b-bd88-a008f00bba9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:23.820966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6b67670b-341b-4c1b-bd88-a008f00bba9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:23.827907 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6b67670b-341b-4c1b-bd88-a008f00bba9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:23.869845 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58452) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:23.875350 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-6b67670b-341b-4c1b-bd88-a008f00bba9e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=22097e6695984b1598d57a183c85bf09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2551560 Nov 15 17:52:23.882120 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b67670b-341b-4c1b-bd88-a008f00bba9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2849ddb-b419-48dc-b903-b2dfa7c3d033,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:23.933274 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:23.955054 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.017826 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.020625 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.021857 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d2849ddb-b419-48dc-b903-b2dfa7c3d033 HTTP/1.1" status: 204 len: 168 time: 0.1507425 Nov 15 17:52:24.030043 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3906e1-5131-4fa9-8064-2f707f0ff4e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2849ddb-b419-48dc-b903-b2dfa7c3d033,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:24.441843 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58488) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:24.474709 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2ec12a7-8413-47a6-847d-1696cdf6d557 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.608259 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2ec12a7-8413-47a6-847d-1696cdf6d557 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.628181 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2ec12a7-8413-47a6-847d-1696cdf6d557 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.676305 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ec12a7-8413-47a6-847d-1696cdf6d557 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a190bab-db03-4d2c-b6d6-7e33b5f1922c,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:24.689182 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e2ec12a7-8413-47a6-847d-1696cdf6d557 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=1ed588ba5c3b4d0dae6ead50ea3bd72a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2454262 Nov 15 17:52:24.691396 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58500) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:24.711265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-389f7971-0aff-4e5c-9cbb-120e924ef56c req-b1d022ca-1b82-478e-9b89-623e6a23fb72 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:24.713068 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-389f7971-0aff-4e5c-9cbb-120e924ef56c req-b1d022ca-1b82-478e-9b89-623e6a23fb72 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.1257229 Nov 15 17:52:24.787645 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-389f7971-0aff-4e5c-9cbb-120e924ef56c req-695093d8-c678-4a99-bd67-0d77a2694bbf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0682917 Nov 15 17:52:24.798210 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.836040 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.899500 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.902816 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:24.906603 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5a190bab-db03-4d2c-b6d6-7e33b5f1922c HTTP/1.1" status: 204 len: 168 time: 0.2111337 Nov 15 17:52:24.912887 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb112e8-5927-4b47-8202-bc3cde4047dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a190bab-db03-4d2c-b6d6-7e33b5f1922c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:25.264245 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58516) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:25.277345 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-da83e35b-4a9d-46c4-bb74-69cf8b9039a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.359268 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-da83e35b-4a9d-46c4-bb74-69cf8b9039a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.364810 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-da83e35b-4a9d-46c4-bb74-69cf8b9039a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.402794 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-da83e35b-4a9d-46c4-bb74-69cf8b9039a4 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=387656582a444160a217f1f301ea9d05&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1374435 Nov 15 17:52:25.403617 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da83e35b-4a9d-46c4-bb74-69cf8b9039a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a642cea-5ee1-4e92-abcf-34878d55f7f2,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:25.405828 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58518) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:25.455674 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.478053 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.531131 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.533710 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:25.534867 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/8a642cea-5ee1-4e92-abcf-34878d55f7f2 HTTP/1.1" status: 204 len: 168 time: 0.1280711 Nov 15 17:52:25.542866 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a2ea22-3da9-45ba-ad10-635ba8614d1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a642cea-5ee1-4e92-abcf-34878d55f7f2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:25.937315 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0013171a-6621-4698-a012-2ad6b9c5c61b req-e4c420f7-7551-492d-8e43-277cf142243e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:25.940195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0013171a-6621-4698-a012-2ad6b9c5c61b req-e4c420f7-7551-492d-8e43-277cf142243e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0638967 Nov 15 17:52:25.991453 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0013171a-6621-4698-a012-2ad6b9c5c61b req-82aa6102-4195-4542-a867-2750fc9a9f51 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457380 Nov 15 17:52:26.029234 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-7ba38824-70eb-450c-88d8-b9de6657ff09 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0430176 Nov 15 17:52:26.047958 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:52:26.102154 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-6aa1e885-1e69-4ef0-982e-6f90fc662ef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:26.104128 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-6aa1e885-1e69-4ef0-982e-6f90fc662ef5 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1099 time: 0.0485234 Nov 15 17:52:26.217679 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-bc1d1112-9f86-4847-8acd-2f1c79bbe1fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:26.219341 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-bc1d1112-9f86-4847-8acd-2f1c79bbe1fc service neutron] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 912 time: 0.0925198 Nov 15 17:52:26.295938 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-8f6d5245-9113-42fa-a75f-ca4eb305746b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 1002 time: 0.0689354 Nov 15 17:52:26.346267 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-1513619a-78b5-4728-b222-3e4bc8718793 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:26.347880 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-1513619a-78b5-4728-b222-3e4bc8718793 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0439184 Nov 15 17:52:26.372563 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58560) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:26.399477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-527156f5-f7ff-4f88-8fb0-02a35982bb69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:26.401513 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-527156f5-f7ff-4f88-8fb0-02a35982bb69 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438559 Nov 15 17:52:26.496918 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-445cbe72-79f1-47af-bf0b-eef8e4e38800 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883667 Nov 15 17:52:26.587642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b22f2c9-28b4-445b-a997-7d2e7ab210fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.593834 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-08003f58-7335-4a9e-8dfb-c56c3600dc2e req-ee2af9d4-fae1-44b5-ae26-3a4424d0c890 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887964 Nov 15 17:52:26.693189 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b22f2c9-28b4-445b-a997-7d2e7ab210fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.699256 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9b22f2c9-28b4-445b-a997-7d2e7ab210fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.736920 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b22f2c9-28b4-445b-a997-7d2e7ab210fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79c37353-e0ae-48e9-bffa-a4107e5c0e37,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:26.744935 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58576) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:26.752102 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9b22f2c9-28b4-445b-a997-7d2e7ab210fe admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8dc48ac017fd4179899df901eca69e5d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3705380 Nov 15 17:52:26.807829 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.831224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.881958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5407d33f-1bc3-4b8d-b84c-da9d9d7321cc req-51eaf6e3-7f92-4a5a-a019-5d76643ecd2d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:26.883929 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5407d33f-1bc3-4b8d-b84c-da9d9d7321cc req-51eaf6e3-7f92-4a5a-a019-5d76643ecd2d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0539484 Nov 15 17:52:26.891785 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.894700 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:26.896040 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/79c37353-e0ae-48e9-bffa-a4107e5c0e37 HTTP/1.1" status: 204 len: 168 time: 0.1501653 Nov 15 17:52:26.904475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8298eac8-f13d-49fb-8694-fa15f4a5df0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79c37353-e0ae-48e9-bffa-a4107e5c0e37,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:26.959630 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5407d33f-1bc3-4b8d-b84c-da9d9d7321cc req-f0a7c653-4635-433e-8806-a103e0d5ca81 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692284 Nov 15 17:52:27.131430 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804e2e69-2d52-4efa-906e-f4902911483b req-d2d085de-49d5-4557-b63e-0abf457ce2a5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:27.133126 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-804e2e69-2d52-4efa-906e-f4902911483b req-d2d085de-49d5-4557-b63e-0abf457ce2a5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0565693 Nov 15 17:52:27.185947 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-804e2e69-2d52-4efa-906e-f4902911483b req-16b87acc-6ddd-482b-91bb-3bc39f9556d1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454810 Nov 15 17:52:27.256953 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58598) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:27.270062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2109d3c9-7bda-4388-805d-4b1e15c4b083 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.349212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2109d3c9-7bda-4388-805d-4b1e15c4b083 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.353511 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2109d3c9-7bda-4388-805d-4b1e15c4b083 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.389323 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2109d3c9-7bda-4388-805d-4b1e15c4b083 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b918eabc5b7746acae4de64b557ace5f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1312454 Nov 15 17:52:27.393811 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58614) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:27.401474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2109d3c9-7bda-4388-805d-4b1e15c4b083 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cdd4bc13-2284-42fd-93e8-7cee74f46a39,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:27.449482 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.471174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.524330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.527002 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:27.528184 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cdd4bc13-2284-42fd-93e8-7cee74f46a39 HTTP/1.1" status: 204 len: 168 time: 0.1334007 Nov 15 17:52:27.537417 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86a594d-8f34-4204-8e2b-b41900aa4169 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cdd4bc13-2284-42fd-93e8-7cee74f46a39,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:27.903662 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58638) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.077364 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6fdda0be-8bca-4dc5-9940-03abaaaeb265 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.115465 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa825dab-e9ea-423f-883e-f6526aa998c0 req-f31d95d5-9fbe-437e-a8fe-37aa398a65ae tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:28.116973 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fa825dab-e9ea-423f-883e-f6526aa998c0 req-f31d95d5-9fbe-437e-a8fe-37aa398a65ae tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0833306 Nov 15 17:52:28.186017 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fa825dab-e9ea-423f-883e-f6526aa998c0 req-4dc9df0a-fed7-4d9d-a92b-d85c96065d7a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0619380 Nov 15 17:52:28.208600 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6fdda0be-8bca-4dc5-9940-03abaaaeb265 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.221495 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6fdda0be-8bca-4dc5-9940-03abaaaeb265 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.262932 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6fdda0be-8bca-4dc5-9940-03abaaaeb265 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7c8d64f65ab747968f8f413be6b2e318&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3580980 Nov 15 17:52:28.265625 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58658) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.272788 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fdda0be-8bca-4dc5-9940-03abaaaeb265 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c52833a3-f785-46be-9c8e-88772e7efc93,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:28.343194 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85337620-1352-4d7f-be11-51ac8134445a req-03be7e28-98b9-40ee-9dcb-14591d4fed0c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:28.344712 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-85337620-1352-4d7f-be11-51ac8134445a req-03be7e28-98b9-40ee-9dcb-14591d4fed0c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0807757 Nov 15 17:52:28.362900 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.402821 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.424046 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-85337620-1352-4d7f-be11-51ac8134445a req-b0f3d743-77f7-4858-bd17-15a24bb024bb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0709617 Nov 15 17:52:28.463874 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.467212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.470692 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c52833a3-f785-46be-9c8e-88772e7efc93 HTTP/1.1" status: 204 len: 168 time: 0.1929421 Nov 15 17:52:28.477524 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c51dc7-f6e3-477d-9d3a-f56101c7b4e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c52833a3-f785-46be-9c8e-88772e7efc93,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:28.654459 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58672) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.741151 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58676) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.760367 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18eba1d0-d15a-4375-bb2d-a1fabfa468c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.772724 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-29851cae-1245-4376-9216-7dced4587b5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.883202 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18eba1d0-d15a-4375-bb2d-a1fabfa468c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.890240 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18eba1d0-d15a-4375-bb2d-a1fabfa468c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.893545 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-29851cae-1245-4376-9216-7dced4587b5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.909016 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-29851cae-1245-4376-9216-7dced4587b5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:28.948702 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-18eba1d0-d15a-4375-bb2d-a1fabfa468c2 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c533a380676145d3b9311366d0c7a22b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2064841 Nov 15 17:52:28.951456 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-29851cae-1245-4376-9216-7dced4587b5f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=60810b021f05484d824c02680d5aa404&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2956920 Nov 15 17:52:28.951595 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58678) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.952294 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18eba1d0-d15a-4375-bb2d-a1fabfa468c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bbd6f46-dc54-4e0b-96a2-33987a4dc2d8,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:28.954511 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58680) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:28.996496 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29851cae-1245-4376-9216-7dced4587b5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd7a5149-a073-46d3-900d-761ab1210763,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:29.004839 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.018388 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.025529 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.039607 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.073009 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.075821 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.077133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7bbd6f46-dc54-4e0b-96a2-33987a4dc2d8 HTTP/1.1" status: 204 len: 168 time: 0.1244490 Nov 15 17:52:29.086606 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3223c334-f68e-417c-adab-b2563002754e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bbd6f46-dc54-4e0b-96a2-33987a4dc2d8,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:29.087216 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.090375 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:29.091672 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/dd7a5149-a073-46d3-900d-761ab1210763 HTTP/1.1" status: 204 len: 168 time: 0.1363249 Nov 15 17:52:29.100542 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f8a3a4-aafc-47ee-ba10-6bd51ccf433e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd7a5149-a073-46d3-900d-761ab1210763,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:29.312616 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44dd727d-0d3f-40a3-991a-b0f5c298fee7 req-ea24b59d-0737-4fa6-92e7-223465726282 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:29.314436 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44dd727d-0d3f-40a3-991a-b0f5c298fee7 req-ea24b59d-0737-4fa6-92e7-223465726282 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0470538 Nov 15 17:52:29.371024 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44dd727d-0d3f-40a3-991a-b0f5c298fee7 req-ad83556a-849d-4993-aa24-75c7a761bf91 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504603 Nov 15 17:52:29.554601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152261fd-8e56-4c9d-b253-973f161be68c req-e0cf78c8-270d-4c79-95d3-ff0b0da02d67 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:29.556275 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-152261fd-8e56-4c9d-b253-973f161be68c req-e0cf78c8-270d-4c79-95d3-ff0b0da02d67 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0490880 Nov 15 17:52:29.604813 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-152261fd-8e56-4c9d-b253-973f161be68c req-66574fce-eca7-46b6-bda6-50eb462e92ae tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423663 Nov 15 17:52:30.512583 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1048c2b6-b17a-449a-82c1-3a1f46354dfd req-d0f6ff30-24fd-43da-9efb-f4af33aae414 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:30.516339 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1048c2b6-b17a-449a-82c1-3a1f46354dfd req-d0f6ff30-24fd-43da-9efb-f4af33aae414 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0695472 Nov 15 17:52:30.566111 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1048c2b6-b17a-449a-82c1-3a1f46354dfd req-54d0e08f-71c5-49c0-adad-2ecb6d31f477 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473893 Nov 15 17:52:30.744081 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdba93c-bfcd-46e5-ab1e-314f41d20de0 req-5b85680d-3c2b-4cdf-946a-1f46795ef79c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:30.745613 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cfdba93c-bfcd-46e5-ab1e-314f41d20de0 req-5b85680d-3c2b-4cdf-946a-1f46795ef79c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0560231 Nov 15 17:52:30.783738 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1f16b50c-cc40-4691-90cc-5e06d32d2794 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:30.798243 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cfdba93c-bfcd-46e5-ab1e-314f41d20de0 req-39eb0055-09e5-4d68-958a-546cc16b73c3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465786 Nov 15 17:52:31.176283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58834) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:31.284293 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0d22f5a4-c02b-4892-8354-7639a354acff admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.364342 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0d22f5a4-c02b-4892-8354-7639a354acff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.369600 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0d22f5a4-c02b-4892-8354-7639a354acff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.407728 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-0d22f5a4-c02b-4892-8354-7639a354acff admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2fab04ea3c8b4fc7a4258acf8dce2e7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2303736 Nov 15 17:52:31.408603 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d22f5a4-c02b-4892-8354-7639a354acff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cbc90c3-64ee-41f2-a4f5-fc750d158c09,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:31.410489 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58838) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:31.463997 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.485485 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.544869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.547881 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.549135 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/6cbc90c3-64ee-41f2-a4f5-fc750d158c09 HTTP/1.1" status: 204 len: 168 time: 0.1369150 Nov 15 17:52:31.564425 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388eb3e1-976a-4357-a451-0899cf966b87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cbc90c3-64ee-41f2-a4f5-fc750d158c09,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:31.686405 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b362f3c5-cd94-4a8a-a8d3-e89965306ed8 req-6740abfe-1810-4105-a421-c54d910b4325 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:31.687922 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b362f3c5-cd94-4a8a-a8d3-e89965306ed8 req-6740abfe-1810-4105-a421-c54d910b4325 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0515649 Nov 15 17:52:31.739422 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b362f3c5-cd94-4a8a-a8d3-e89965306ed8 req-27c577d8-7421-459d-8429-07cb6c62339e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455260 Nov 15 17:52:31.825975 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58848) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:31.839550 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-791d9e89-ee5d-4f51-9c17-8c9f289f639b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.952846 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8d0bc9-cd8b-4df0-9838-0fe9972b735c req-f0d66230-0500-40c9-bb83-39ca1b652c65 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:31.954352 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1e8d0bc9-cd8b-4df0-9838-0fe9972b735c req-f0d66230-0500-40c9-bb83-39ca1b652c65 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0747054 Nov 15 17:52:31.958791 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-791d9e89-ee5d-4f51-9c17-8c9f289f639b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:31.967605 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-791d9e89-ee5d-4f51-9c17-8c9f289f639b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:32.022431 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-791d9e89-ee5d-4f51-9c17-8c9f289f639b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=29af1984e7244564b6190ea65ae4747a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1953492 Nov 15 17:52:32.025916 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58852) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:32.028960 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-791d9e89-ee5d-4f51-9c17-8c9f289f639b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f011b11a-98a9-4240-b174-41f0ab639435,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:32.038556 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1e8d0bc9-cd8b-4df0-9838-0fe9972b735c req-13a98ecf-f572-431f-8e7d-db388a4b1902 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0776494 Nov 15 17:52:32.076113 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:32.096745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:32.145204 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:32.147773 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:32.148911 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f011b11a-98a9-4240-b174-41f0ab639435 HTTP/1.1" status: 204 len: 168 time: 0.1216712 Nov 15 17:52:32.156797 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00b1a1f8-1011-4da3-bdc3-69c42d9b5fe6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f011b11a-98a9-4240-b174-41f0ab639435,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:32.865379 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00adfc27-834a-41aa-b4e3-11930c762159 req-477ec537-5249-4e8b-826e-4855c7774d34 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:32.866883 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-00adfc27-834a-41aa-b4e3-11930c762159 req-477ec537-5249-4e8b-826e-4855c7774d34 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0517118 Nov 15 17:52:32.916663 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-00adfc27-834a-41aa-b4e3-11930c762159 req-239a167e-3793-4737-8d3f-663b6baf2fea tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422974 Nov 15 17:52:33.078574 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5e9fafc1-3d04-4a7c-acad-f76c7942f41a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.164338 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adcd2897-39fe-4f90-9d50-5905009b701e req-434ec984-6b69-48e4-9535-b4b2fae46f78 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:33.166263 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adcd2897-39fe-4f90-9d50-5905009b701e req-434ec984-6b69-48e4-9535-b4b2fae46f78 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 943 time: 0.0506341 Nov 15 17:52:33.217904 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-adcd2897-39fe-4f90-9d50-5905009b701e req-b7240760-9ea1-4ece-ab6d-f87d814c0684 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444980 Nov 15 17:52:33.297232 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58892) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:33.414989 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8951feaf-0e92-4d9f-a0f6-288bfc944e80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.493387 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8951feaf-0e92-4d9f-a0f6-288bfc944e80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.499371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8951feaf-0e92-4d9f-a0f6-288bfc944e80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.539222 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8951feaf-0e92-4d9f-a0f6-288bfc944e80 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=0a8b3106b95c42578f8b3f45059f7250&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2409246 Nov 15 17:52:33.540070 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8951feaf-0e92-4d9f-a0f6-288bfc944e80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe235af7-8a4a-43de-b61f-8ed7f1dce6b4,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:33.542543 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58896) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:33.599282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.625828 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.677822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.680411 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:33.681713 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fe235af7-8a4a-43de-b61f-8ed7f1dce6b4 HTTP/1.1" status: 204 len: 168 time: 0.1380894 Nov 15 17:52:33.689403 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6bfa3fd-7e14-4c29-a78e-103dcb3c2e73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe235af7-8a4a-43de-b61f-8ed7f1dce6b4,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:33.922738 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:52:34.039133 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:34.041001 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e44822-79d7-4c64-a445-4aff127b3bbf req-344a15a0-70db-43a3-8e30-bfeb2259387a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:34.043165 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-47e44822-79d7-4c64-a445-4aff127b3bbf req-344a15a0-70db-43a3-8e30-bfeb2259387a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0525835 Nov 15 17:52:34.051144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'mac_address': 'fa:16:3e:e6:46:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:52:34.096521 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.109365 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-47e44822-79d7-4c64-a445-4aff127b3bbf req-bd0b9cf3-0f8a-4508-a188-e167f06dcae5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582123 Nov 15 17:52:34.109734 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:52:34.133464 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:34.139762 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.190118 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=9']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:34.340187 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517061b0-2973-4538-a29b-a75ba0f6e8db req-55a9b4f4-ed4c-4ae0-a8fb-b47755243975 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:34.341646 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-517061b0-2973-4538-a29b-a75ba0f6e8db req-55a9b4f4-ed4c-4ae0-a8fb-b47755243975 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.0497956 Nov 15 17:52:34.371668 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 58924) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:34.390280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-517061b0-2973-4538-a29b-a75ba0f6e8db req-24b20375-a7b7-4011-9060-d6c12e1f8301 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418508 Nov 15 17:52:34.399369 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['db874a84-aa99-4b23-9465-3c565bb54cf2'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:52:34.471021 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.482073 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1780574719-network', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:34.506985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Made reservation on behalf of 02ec9c6dcc7d48c5b52b4ee146d42ec8 for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:34.509512 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.518031 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.594476 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.598743 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.622958 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] vlan segment allocate from pool success with {'vlan_id': 430, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:52:34.633265 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=147fbaa0-d208-48fa-8f36-ef1d41e3445f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:34.642939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.643307 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Added segment 47d0b0f5-1317-4399-8742-1fd52fe341fc of type vlan for network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 Nov 15 17:52:34.684350 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.715326 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.716323 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:34.716912 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:34.998961 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6260362 Nov 15 17:52:35.001969 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58930) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:35.004040 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Pushing event updated for resources: {'Network': ['ID=225bbc0e-9530-4b54-be05-d3092f2f1bf3,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:35.006905 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Request body: {'subnet': {'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1780574719-subnet', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:35.011125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.011474 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.011853 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.012224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.012649 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.013034 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.013363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.013685 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.014027 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.014361 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.014679 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.015029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16d55dbf-26bc-480e-8ddd-172bb97ddf62 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:35.029864 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:52:35.030296 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Made reservation on behalf of 02ec9c6dcc7d48c5b52b4ee146d42ec8 for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:35.032875 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-59344358'] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.230866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59170246', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-59344372'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.284925 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10ff818-147c-4862-ac00-3336c29ca5a0 req-e48c9b0c-3f52-4701-88de-55765df5230c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:35.286300 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a10ff818-147c-4862-ac00-3336c29ca5a0 req-e48c9b0c-3f52-4701-88de-55765df5230c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0996547 Nov 15 17:52:35.317214 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Pushing event updated for resources: {'Subnet': ['ID=4800e8bb-9314-46c0-b919-995a65894f5c,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:35.341630 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:35.342007 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Network hostable DHCP agents. Network: 225bbc0e-9530-4b54-be05-d3092f2f1bf3, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:52:35.362884 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a10ff818-147c-4862-ac00-3336c29ca5a0 req-66f98963-caf6-49b2-adcb-4c003c713b63 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0685399 Nov 15 17:52:35.373978 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:52:35.384483 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 225bbc0e-9530-4b54-be05-d3092f2f1bf3) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:35.389341 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:35.389953 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.393683 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce71073f-f153-4979-ad3c-61f25eeb7a82 None None] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:35.410096 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b1f5b9cf-1bd7-429e-b6c7-e78ccc090dfe admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4045687 Nov 15 17:52:35.410324 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58934) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:35.414532 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:35.439488 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.440779 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.505491 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.560559 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:52:35.561465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.590589 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.617203 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f00b1b-4533-40a5-98e0-2f79f471b701 req-9ca1965a-1ec8-45d2-bdd2-9d9483524668 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:35.619161 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f00b1b-4533-40a5-98e0-2f79f471b701 req-9ca1965a-1ec8-45d2-bdd2-9d9483524668 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 944 time: 0.1264775 Nov 15 17:52:35.698683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.710473 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Allocated IP 172.20.0.2 (225bbc0e-9530-4b54-be05-d3092f2f1bf3/4800e8bb-9314-46c0-b919-995a65894f5c/5bfc573a-0464-414f-a3f0-c3655d1aacfe) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:35.766616 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f00b1b-4533-40a5-98e0-2f79f471b701 req-2ad48af4-baa5-44b4-9912-9612bfb8edc4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1162686 Nov 15 17:52:35.863986 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.873181 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.913554 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:35.918626 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:35.924087 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:35.926152 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:35.929065 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.948774 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:35.949840 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Pushing event updated for resources: {'Port': ['ID=5bfc573a-0464-414f-a3f0-c3655d1aacfe,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:36.058659 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Allocated IP 172.27.0.48 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/cd5d17e1-ccf5-45e3-908e-2e9ac9337d06) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:36.145110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Attempting to bind port 5bfc573a-0464-414f-a3f0-c3655d1aacfe on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:36.145348 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Attempting to bind port 5bfc573a-0464-414f-a3f0-c3655d1aacfe by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:36.145704 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Attempting to bind port 5bfc573a-0464-414f-a3f0-c3655d1aacfe on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:36.151869 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port db874a84-aa99-4b23-9465-3c565bb54cf2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:36.152281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.153807 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:36.154209 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:36.154539 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.154918 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Bound using segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:36.155471 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Bound port: 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:36.155747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.161374 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.200561 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.244429 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:36.248345 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:36.250112 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Pushing event updated for resources: {'Port': ['ID=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:36.252325 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:36.281364 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] For port 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:36.285832 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] For port 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5bfc573a-0464-414f-a3f0-c3655d1aacfe,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:36.290607 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.294018 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.350461 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:52:36.352733 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f57f365f-dca1-40a5-a69c-47b09597d3d7" -d '{"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:52:36.375628 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:36.380909 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32322a9d-69bf-4463-a27f-25ca064cd1ac None None] Pushing event updated for resources: {'Port': ['ID=5bfc573a-0464-414f-a3f0-c3655d1aacfe,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:36.384606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.425845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:52:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a1aaa2e-be9a-4624-ae5e-ca24a7ae3222 x-openstack-request-id: req-1a1aaa2e-be9a-4624-ae5e-ca24a7ae3222 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:52:36.426456 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-plugged", "status": "completed", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:52:36.426456 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1a1aaa2e-be9a-4624-ae5e-ca24a7ae3222 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:52:36.426875 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'code': 200} Nov 15 17:52:36.444866 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=10']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:36.679179 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.797439 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d703a6a7-2c87-488f-a39a-dd4001b3195a req-1d2117ab-698c-4df6-9884-c052a5634a44 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:36.808109 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d703a6a7-2c87-488f-a39a-dd4001b3195a req-1d2117ab-698c-4df6-9884-c052a5634a44 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0744147 Nov 15 17:52:36.826462 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:36.873223 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dc82b5-24be-45fc-ad03-de2706e1849d req-c214136e-b292-41ac-bb11-90316282b83f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:36.875342 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-03dc82b5-24be-45fc-ad03-de2706e1849d req-c214136e-b292-41ac-bb11-90316282b83f service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1099 time: 0.0417399 Nov 15 17:52:36.925848 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-03dc82b5-24be-45fc-ad03-de2706e1849d req-fd32ed67-7e5e-4858-b7fb-82a3f7c7e2c8 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432897 Nov 15 17:52:36.964620 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d703a6a7-2c87-488f-a39a-dd4001b3195a req-bcdc64b4-fa4d-4dda-a3b2-dec3d84a3522 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1555157 Nov 15 17:52:36.981050 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bf5607-114b-41ef-8a3f-1047d5269bc6 req-99ecb1b5-6e2f-473b-bc39-ae947b557d9f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:36.982490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-70bf5607-114b-41ef-8a3f-1047d5269bc6 req-99ecb1b5-6e2f-473b-bc39-ae947b557d9f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.1187365 Nov 15 17:52:37.102614 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-70bf5607-114b-41ef-8a3f-1047d5269bc6 req-7a10b080-71c0-4f0d-9636-add313238248 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1121585 Nov 15 17:52:37.126087 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.262148 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:52:37.356215 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a863d84-0ec0-42ce-8128-162169d09af5 None None] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:37.376146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:52:37.394649 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.398510 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3459aa9d-7998-4703-919a-6a6c4a585820 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.9844675 Nov 15 17:52:37.398510 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 58948) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:37.399469 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:52:37.458752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:37.459434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:37.463063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] Provisioning complete for port 5bfc573a-0464-414f-a3f0-c3655d1aacfe triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:37.463588 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.541703 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5bfc573a-0464-414f-a3f0-c3655d1aacfe up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:37.705172 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:37.791447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 5bfc573a-0464-414f-a3f0-c3655d1aacfe triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:37.791841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.837732 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.856549 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:37.942473 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] For port 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5bfc573a-0464-414f-a3f0-c3655d1aacfe,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:37.970397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.032671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Allocated IP 172.20.0.1 (225bbc0e-9530-4b54-be05-d3092f2f1bf3/4800e8bb-9314-46c0-b919-995a65894f5c/b34f97c1-f783-4899-80af-c491a59b2552) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:38.083967 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3809160a-96ad-42ee-a3a7-2b72c55c9af3 None None] Pushing event updated for resources: {'Port': ['ID=5bfc573a-0464-414f-a3f0-c3655d1aacfe,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:38.105922 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-c5112987-7918-453c-ac3e-91a9de2c8466 None None] Provisioning complete for port 5bfc573a-0464-414f-a3f0-c3655d1aacfe triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:38.106293 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c5112987-7918-453c-ac3e-91a9de2c8466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.114200 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:36Z', 'revision_number': 3, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:38.168750 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec5bbbe-2237-454b-9f94-26857a6b6afb req-07d04421-f313-4022-8640-1ceff7e5737a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:38.170215 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dec5bbbe-2237-454b-9f94-26857a6b6afb req-07d04421-f313-4022-8640-1ceff7e5737a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0766158 Nov 15 17:52:38.193797 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:52:38.194091 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Updating router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:52:38.218165 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.229801 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.278814 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-dec5bbbe-2237-454b-9f94-26857a6b6afb req-3f0cded5-147a-4bd8-beb7-e6613075662e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970254 Nov 15 17:52:38.308301 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ea4b43-62e7-47e5-96fe-dbeec107e61a req-9b4e77f2-dd93-4abc-a512-775fff47d1d2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:38.309898 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b5ea4b43-62e7-47e5-96fe-dbeec107e61a req-9b4e77f2-dd93-4abc-a512-775fff47d1d2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0983186 Nov 15 17:52:38.326068 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.384298 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:38.396647 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:38.404348 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:38.414969 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Pushing event updated for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:38.472682 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.481200 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b5ea4b43-62e7-47e5-96fe-dbeec107e61a req-f54742b7-881e-4426-a18b-a3ffbbcfd60f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1641252 Nov 15 17:52:38.709411 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.717807 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.729892 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2538fc-2ba3-4abb-9f2d-ab6550a4fb31 req-cc913071-e502-4a91-bda2-009ceef5fe0e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:38.733444 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.737919 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa2538fc-2ba3-4abb-9f2d-ab6550a4fb31 req-cc913071-e502-4a91-bda2-009ceef5fe0e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.1103885 Nov 15 17:52:38.744366 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-96c9f10a-8fd7-4065-92b6-e4d3a060ee39 None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:38.744723 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-96c9f10a-8fd7-4065-92b6-e4d3a060ee39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.761446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-a17af8f8-48fd-4169-989d-7a26b8d14edc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:38.763927 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-a17af8f8-48fd-4169-989d-7a26b8d14edc service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 1099 time: 0.0724437 Nov 15 17:52:38.824299 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aa2538fc-2ba3-4abb-9f2d-ab6550a4fb31 req-0fe17242-c761-4896-bf28-a7babb82630a tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855303 Nov 15 17:52:38.841204 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Attempting to bind port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:38.841458 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Attempting to bind port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:38.841792 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Attempting to bind port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:38.852117 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-96c9f10a-8fd7-4065-92b6-e4d3a060ee39 None None] Port b34f97c1-f783-4899-80af-c491a59b2552 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:52:38.855922 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30240e62-2758-40e3-a00c-7cc1089804dd None None] Pushing event updated for resources: {'Port': ['ID=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:38.858800 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:38.859141 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:38.859535 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.860328 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:38.860445 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Bound port: cd5d17e1-ccf5-45e3-908e-2e9ac9337d06, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:38.860759 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:38.900124 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-f52558eb-b1f1-4e82-9686-d5757d8954ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:38.901623 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-f52558eb-b1f1-4e82-9686-d5757d8954ab service neutron] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 912 time: 0.1303387 Nov 15 17:52:38.928079 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] For port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:38.932949 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] For port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:38.942165 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.001807 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-acf639f3-828a-45b4-8e44-c0b201132377 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 200 len: 1002 time: 0.0901077 Nov 15 17:52:39.012526 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.020830 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.025504 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30240e62-2758-40e3-a00c-7cc1089804dd None None] Pushing event updated for resources: {'Port': ['ID=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:39.033446 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:39.034136 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:39.076778 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-775c0c9b-05a9-4d00-9c36-7d8c84d2ecdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:39.079889 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-775c0c9b-05a9-4d00-9c36-7d8c84d2ecdb service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0685437 Nov 15 17:52:39.102471 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Pushing event updated for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:39.107754 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.131363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-f4088c82-2f39-4421-9ee2-48b4058b0459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:39.133011 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-f4088c82-2f39-4421-9ee2-48b4058b0459 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0459154 Nov 15 17:52:39.219432 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:39.220930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:39.254751 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-5b7aa334-db44-40ee-9468-0133017adafd service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1122613 Nov 15 17:52:39.319984 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:39.343035 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:52:39.388951 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2fade3b8-d9f5-414b-b144-0cbdae5d8907 req-907a9cb9-d1ac-4380-9f9e-75d2e65bdc98 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238542 Nov 15 17:52:39.495447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5bfc573a-0464-414f-a3f0-c3655d1aacfe up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:39.602398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8605055a-de76-48c8-9acd-2f3ef29f6afb None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:39.602905 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8605055a-de76-48c8-9acd-2f3ef29f6afb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.640290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 5bfc573a-0464-414f-a3f0-c3655d1aacfe triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:39.640622 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:39.686869 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-8605055a-de76-48c8-9acd-2f3ef29f6afb None None] Port b34f97c1-f783-4899-80af-c491a59b2552 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:52:39.695712 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 2, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:39.725601 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de47d2a8-17e0-411c-83e3-00ecbdc5ddf8 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 2, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:52:39.729573 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:52:39.734848 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5b5bb993-650b-48d6-b326-5f6515e9fa75 admin admin] 10.222.0.31 "PUT /v2.0/routers/e781591d-919c-4b7b-9349-8d2ed2dc1fd6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3344905 Nov 15 17:52:39.743182 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a319eff4-8410-4543-abf0-f9f3bb129456 req-f4f94ad3-9d11-4456-8a25-3f4f4c099986 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:39.745117 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a319eff4-8410-4543-abf0-f9f3bb129456 req-f4f94ad3-9d11-4456-8a25-3f4f4c099986 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0736704 Nov 15 17:52:39.807160 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a319eff4-8410-4543-abf0-f9f3bb129456 req-e95a0711-a2a4-47f3-ba19-b206ca4fbe3f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521154 Nov 15 17:52:39.974795 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28a0287-f653-4017-bed8-d1481aae8ae9 req-f7c9e7d8-6a91-4e03-ad5f-2715a5808d84 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:39.976838 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e28a0287-f653-4017-bed8-d1481aae8ae9 req-f7c9e7d8-6a91-4e03-ad5f-2715a5808d84 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0771735 Nov 15 17:52:40.088199 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e28a0287-f653-4017-bed8-d1481aae8ae9 req-b28132fa-de53-45be-8852-5895da8da1e0 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1045125 Nov 15 17:52:40.347055 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59018) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:40.352026 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-680617592-network', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:40.373999 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Made reservation on behalf of 103cb3e2cd054174b3c5891117ab586a for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:40.376538 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.391189 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.484232 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.489219 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.516391 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] vlan segment allocate from pool success with {'vlan_id': 425, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:52:40.530932 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f48dad76-d7fe-4469-9561-b0038da467c5,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:40.537515 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.537942 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Added segment 78968176-96ff-4a6a-916a-b46b0374f247 of type vlan for network 59245f04-b934-41a1-962b-b90d1d4fd2a7 Nov 15 17:52:40.583457 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.609526 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.610406 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:40.611299 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.673385 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3251736 Nov 15 17:52:40.676050 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59020) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:40.680884 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Request body: {'subnet': {'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-680617592-subnet', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:40.693852 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6941feaf-894c-4fe8-bb35-72bf77407bdd admin admin] Pushing event updated for resources: {'Network': ['ID=59245f04-b934-41a1-962b-b90d1d4fd2a7,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:40.707808 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:52:40.721208 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Made reservation on behalf of 103cb3e2cd054174b3c5891117ab586a for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:40.724088 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-59344358'] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.900924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59170246', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-59344372'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:40.954190 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Pushing event updated for resources: {'Subnet': ['ID=f5225772-6a11-4da0-ae44-6f3385feeb4a,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:40.972369 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Checking segment: {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:40.972816 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Network hostable DHCP agents. Network: 59245f04-b934-41a1-962b-b90d1d4fd2a7, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:52:40.996135 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:52:41.005407 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 59245f04-b934-41a1-962b-b90d1d4fd2a7) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:41.011556 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:41.012697 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.015664 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da3d74b2-f6da-4864-a497-c5e8ab530367 None None] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:41.029946 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0a759622-ab1d-475a-aa24-2367ab19da0f admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3528693 Nov 15 17:52:41.033278 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59022) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:41.037656 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:41.061592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.062857 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.116024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.176807 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-59245f04-b934-41a1-962b-b90d1d4fd2a7', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:52:41.177676 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.292361 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.304763 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ffeacb-4f14-4166-8e17-13610d7620bc req-3c5e767b-1b48-4692-84ce-14f2a964a78c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:41.306522 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c7ffeacb-4f14-4166-8e17-13610d7620bc req-3c5e767b-1b48-4692-84ce-14f2a964a78c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.1195207 Nov 15 17:52:41.317012 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Allocated IP 172.20.0.2 (59245f04-b934-41a1-962b-b90d1d4fd2a7/f5225772-6a11-4da0-ae44-6f3385feeb4a/5e18d761-908f-4ffd-b238-2bf479349d9c) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:41.400271 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c7ffeacb-4f14-4166-8e17-13610d7620bc req-97c43af9-4432-4455-86b1-8f11d2785a6d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0872273 Nov 15 17:52:41.502533 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.512290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.549420 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:41.562076 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.582174 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.608262 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:41.611150 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:41.615353 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:41.619405 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Pushing event updated for resources: {'Port': ['ID=5e18d761-908f-4ffd-b238-2bf479349d9c,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:41.631461 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.631932 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.632230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.632450 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.632780 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.633170 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.633416 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.633732 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.634167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.634395 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.634912 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.635238 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:41.696386 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:41.696833 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.699490 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Attempting to bind port 5e18d761-908f-4ffd-b238-2bf479349d9c on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:41.699886 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Attempting to bind port 5e18d761-908f-4ffd-b238-2bf479349d9c by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:41.700243 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Attempting to bind port 5e18d761-908f-4ffd-b238-2bf479349d9c on network 59245f04-b934-41a1-962b-b90d1d4fd2a7 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:41.704413 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Allocated IP 172.27.0.214 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/9d95240a-ccfa-4ed4-9a44-c87e35b3805e) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:41.724482 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:41.724869 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Checking segment: {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:41.725274 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.725665 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Bound using segment: {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:41.726139 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Bound port: 5e18d761-908f-4ffd-b238-2bf479349d9c, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:41.726522 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.813239 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.839222 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] For port 5e18d761-908f-4ffd-b238-2bf479349d9c, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:41.844303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] For port 5e18d761-908f-4ffd-b238-2bf479349d9c, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5e18d761-908f-4ffd-b238-2bf479349d9c,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:41.845577 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:52:41.847120 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.853331 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.855129 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.856945 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:41.857858 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:41.890643 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:41.896541 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:41.898866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:41.903850 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:41.914174 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:41.932834 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6020ea0-489a-458a-95dc-5e71fcc11f45 None None] Pushing event updated for resources: {'Port': ['ID=5e18d761-908f-4ffd-b238-2bf479349d9c,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:41.933235 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Pushing event updated for resources: {'Port': ['ID=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:41.990376 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:41.997507 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:42.215195 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.240632 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 2, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:42.269190 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:52:42.269542 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Updating router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 port b34f97c1-f783-4899-80af-c491a59b2552 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:52:42.293830 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.405777 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.531011 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Router 3aa8b869-37d4-425e-b171-c047e6dc9e96 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:52:42.556477 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.562635 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.616953 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Pushing event updated for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:42.648697 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.649318 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.649833 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.650308 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.650774 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.651351 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.652398 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.652950 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.653501 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.654020 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.654570 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.655096 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:52:42.664517 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:52:42.673842 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Sync routers for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:52:42.688994 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:42.690815 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:42.695217 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.695513 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Attempting to bind port b34f97c1-f783-4899-80af-c491a59b2552 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:42.695616 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Attempting to bind port b34f97c1-f783-4899-80af-c491a59b2552 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:42.696074 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Attempting to bind port b34f97c1-f783-4899-80af-c491a59b2552 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:42.697571 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-9fef1736-5c5e-4e53-becc-c6798531754a admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.6639259 Nov 15 17:52:42.700344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59044) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:42.706025 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:42.706401 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:42.706799 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.707183 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Bound using segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:42.707654 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Bound port: b34f97c1-f783-4899-80af-c491a59b2552, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:42.708105 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.799177 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] For port b34f97c1-f783-4899-80af-c491a59b2552, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:42.811839 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] For port b34f97c1-f783-4899-80af-c491a59b2552, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b34f97c1-f783-4899-80af-c491a59b2552,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:42.821119 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:42.823965 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:42.887058 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc07f83-bcfc-4520-89c3-1e3d7645c7c9 None None] Pushing event updated for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:42.916930 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:42.917571 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:42.979680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:42.980373 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.061009 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:43.078752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36414127-e88d-47ae-a4d1-f2ed2eb75c6c None None] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:43.306177 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:42Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:43.336570 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c393b94f-c582-4058-8fc0-e9e86c77223d None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:42Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:52:43.354578 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.426368 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:42Z', 'revision_number': 3, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:43.435106 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] For port b34f97c1-f783-4899-80af-c491a59b2552, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b34f97c1-f783-4899-80af-c491a59b2552,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:43.468364 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.485413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Checking router: 3aa8b869-37d4-425e-b171-c047e6dc9e96 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:52:43.485413 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Updating router 3aa8b869-37d4-425e-b171-c047e6dc9e96 port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:52:43.499007 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.548507 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.608296 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af7663e2-f2d6-436c-8474-e6d1fbe12d7f None None] Pushing event updated for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:43.675635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5e18d761-908f-4ffd-b238-2bf479349d9c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:43.698929 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Provisioning complete for port 5e18d761-908f-4ffd-b238-2bf479349d9c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:43.699290 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.702335 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Allocated IP 172.20.0.1 (59245f04-b934-41a1-962b-b90d1d4fd2a7/f5225772-6a11-4da0-ae44-6f3385feeb4a/33240b16-e01c-400d-9083-3e4dde7e2ccd) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:43.843872 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.845957 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 5e18d761-908f-4ffd-b238-2bf479349d9c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:43.846462 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.882956 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.921285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:43.926358 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:43.930001 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:43.962491 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Pushing event updated for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:43.969417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:43.980462 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.072633 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] For port 5e18d761-908f-4ffd-b238-2bf479349d9c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5e18d761-908f-4ffd-b238-2bf479349d9c,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:44.079639 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.085827 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.094601 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.108853 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.127997 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.180691 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:44.181070 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.234505 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Attempting to bind port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:44.234875 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Attempting to bind port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:44.235231 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Attempting to bind port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:44.239595 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c47ea0f7-cbdd-449f-b90c-ddb7bc4a75d4 None None] Pushing event updated for resources: {'Port': ['ID=5e18d761-908f-4ffd-b238-2bf479349d9c,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:44.251629 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.db.api [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108143) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 15 17:52:44.251966 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG oslo_db.api [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 15 17:52:44.275281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:44.275649 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:44.276075 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.276460 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:44.276949 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Bound port: 9d95240a-ccfa-4ed4-9a44-c87e35b3805e, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:44.277323 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.325538 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59c3343-bf95-4f8a-a1c5-29b570d33a69 None None] Pushing event updated for resources: {'Port': ['ID=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:44.330423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.336253 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.371037 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] For port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:44.388964 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] For port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:44.397718 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.406439 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.409477 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Pushing event updated for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:44.458560 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:44.459176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:44.462752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59c3343-bf95-4f8a-a1c5-29b570d33a69 None None] Pushing event updated for resources: {'Port': ['ID=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:44.501010 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:44.502386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:44.553670 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-1336aa75-3c3c-4500-9708-6db0e35bcd85 None None] Provisioning complete for port 33240b16-e01c-400d-9083-3e4dde7e2ccd triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:44.554095 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1336aa75-3c3c-4500-9708-6db0e35bcd85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.608220 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:44.610393 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-1336aa75-3c3c-4500-9708-6db0e35bcd85 None None] Port 33240b16-e01c-400d-9083-3e4dde7e2ccd cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:52:44.619752 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Router 3aa8b869-37d4-425e-b171-c047e6dc9e96 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:52:44.687664 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-1336aa75-3c3c-4500-9708-6db0e35bcd85 None None] Provisioning complete for port 5e18d761-908f-4ffd-b238-2bf479349d9c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:44.688230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1336aa75-3c3c-4500-9708-6db0e35bcd85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.728413 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:52:44.733539 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3c51831a-d2e3-496f-a86b-dd3b67b94941 admin admin] 10.222.0.31 "PUT /v2.0/routers/3aa8b869-37d4-425e-b171-c047e6dc9e96/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0319390 Nov 15 17:52:44.822146 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:44.936863 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:44.937178 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:44.976737 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '33240b16-e01c-400d-9083-3e4dde7e2ccd', 'name': '', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'mac_address': 'fa:16:3e:fa:fc:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:43Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 2, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'subnets': [{'id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:45.010276 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-372c568e-cc8f-4f3e-b41b-8ea729b2c53d None None] The sync data for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi is: [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '33240b16-e01c-400d-9083-3e4dde7e2ccd', 'name': '', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'mac_address': 'fa:16:3e:fa:fc:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:43Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 2, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'subnets': [{'id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:52:45.060844 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b34f97c1-f783-4899-80af-c491a59b2552 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:45.064307 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-a828a685-9eb6-41d8-a897-4f9f691d1689 None None] Provisioning complete for port 33240b16-e01c-400d-9083-3e4dde7e2ccd triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:45.064660 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a828a685-9eb6-41d8-a897-4f9f691d1689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:45.125521 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-a828a685-9eb6-41d8-a897-4f9f691d1689 None None] Port 33240b16-e01c-400d-9083-3e4dde7e2ccd cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:52:45.137785 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:45.138141 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:45.490979 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5e18d761-908f-4ffd-b238-2bf479349d9c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:45.544052 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 5e18d761-908f-4ffd-b238-2bf479349d9c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:45.544401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:45.634147 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b34f97c1-f783-4899-80af-c491a59b2552 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:45.696017 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b34f97c1-f783-4899-80af-c491a59b2552 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:45.697063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.328028 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59074) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:46.333058 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1950932927', 'description': 'tempest-secgroup-smoke-1950932927 description', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:46.358634 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.439857 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.445648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.476667 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.480799 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1490102 Nov 15 17:52:46.480997 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59076) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:46.485541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:46.489795 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370f7509-f634-408d-9977-0b8b69715d4d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d1957e86-4d23-410d-832b-14bd8f646ece,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:46.518568 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.584117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.588235 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.607002 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=643897e3-f478-491b-9829-53a6e77dfc78,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:46.616663 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.620673 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-05e10318-9295-4cc9-a46c-5f7e6f7b85cd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1385996 Nov 15 17:52:46.621283 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59078) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:46.625988 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:46.657960 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.716669 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.721341 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.738183 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dd1136bd-4d6c-46ae-96cb-3aafcb7c0c2c,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:46.758416 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.759786 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-28234600-e16b-421f-8442-8f6acc212400 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1374190 Nov 15 17:52:46.767588 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59084) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:46.772351 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:46.800080 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.863381 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.869030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.886058 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81316e29-15fa-4b99-a183-59a6d642974a,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:46.895400 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.896745 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b8b8aa26-7507-467c-a5b2-7e67512cbe75 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1280179 Nov 15 17:52:46.899676 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59086) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:46.904301 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:46.934730 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.995295 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:46.999728 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.018519 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=487a224f-a1b5-4589-bd52-95809322bc2d,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.018745 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59090) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:47.028991 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.032785 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-636e8d5d-5d45-41ab-9728-2be154b6c13e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1294637 Nov 15 17:52:47.032935 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59094) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:47.037258 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:47.061102 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.securitygroups_db [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Project 02ec9c6dcc7d48c5b52b4ee146d42ec8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:52:47.066468 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.130649 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.133697 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-335ced05-e9a1-4220-8a09-c9259d6a740f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.135377 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.154679 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f128f232-1e87-4b23-9b89-f11c038fe8be,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.166959 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.168477 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-7dcec422-16f3-4ec2-9bf3-1759521e34bd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1343629 Nov 15 17:52:47.171439 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59096) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:47.177553 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'security_group_rule': {'security_group_id': 'd1957e86-4d23-410d-832b-14bd8f646ece', 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:47.215961 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.securitygroups_db [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Project 02ec9c6dcc7d48c5b52b4ee146d42ec8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:52:47.229276 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.252415 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-335ced05-e9a1-4220-8a09-c9259d6a740f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.257427 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-335ced05-e9a1-4220-8a09-c9259d6a740f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.322497 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-335ced05-e9a1-4220-8a09-c9259d6a740f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=0be7190ad60d404c926ef9295ff9021c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2993109 Nov 15 17:52:47.322818 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59098) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:47.329577 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-335ced05-e9a1-4220-8a09-c9259d6a740f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=032c5c87-0716-46ff-adbd-902fd2778eb1,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.348095 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.357504 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.386095 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0aee5b74-7ff4-4e9e-bad7-1780b6031b20,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.398485 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.403340 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-18b1ab7c-a9a4-4e77-9ff5-52aeaf7bf6b9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2272696 Nov 15 17:52:47.411278 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.439472 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.496522 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.500107 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.501596 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/032c5c87-0716-46ff-adbd-902fd2778eb1 HTTP/1.1" status: 204 len: 168 time: 0.1778717 Nov 15 17:52:47.502033 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Sync routers for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:52:47.520580 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d557b5-2768-49d7-a1fd-257ca933bca8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=032c5c87-0716-46ff-adbd-902fd2778eb1,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.520830 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d95240a-ccfa-4ed4-9a44-c87e35b3805e up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:47.537979 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:47.538621 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:47.580947 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:47.581530 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.677006 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.708020 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:47.718403 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:47.781390 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:47.830870 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:48.052244 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '33240b16-e01c-400d-9083-3e4dde7e2ccd', 'name': '', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'mac_address': 'fa:16:3e:fa:fc:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:43Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 2, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'subnets': [{'id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:48.079513 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Checking router: 3aa8b869-37d4-425e-b171-c047e6dc9e96 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:52:48.079899 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Updating router 3aa8b869-37d4-425e-b171-c047e6dc9e96 port 33240b16-e01c-400d-9083-3e4dde7e2ccd binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:52:48.108703 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.243530 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59176) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:48.352029 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-152056715-network', 'tenant_id': '6cd9979609f846739626991354158923'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:48.375399 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Made reservation on behalf of 6cd9979609f846739626991354158923 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:48.378138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.380271 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.386032 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.388958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.435890 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d3002b-cfdf-452c-8cd7-1096bdaa2e37 None None] Pushing event updated for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:48.486216 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.490535 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.501831 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Attempting to bind port 33240b16-e01c-400d-9083-3e4dde7e2ccd on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:48.502366 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Attempting to bind port 33240b16-e01c-400d-9083-3e4dde7e2ccd by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:48.502968 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Attempting to bind port 33240b16-e01c-400d-9083-3e4dde7e2ccd on network 59245f04-b934-41a1-962b-b90d1d4fd2a7 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:48.508294 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:48.508759 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Checking segment: {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:48.509277 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.509741 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Bound using segment: {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:48.510129 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Bound port: 33240b16-e01c-400d-9083-3e4dde7e2ccd, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78968176-96ff-4a6a-916a-b46b0374f247', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:48.510513 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.517838 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] vlan segment allocate from pool success with {'vlan_id': 436, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:52:48.527366 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dfa126b-32af-4cf4-9620-4acda7be44ce,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:48.534645 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.535081 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Added segment 48817ff7-f169-4190-a1e6-86ed572c5002 of type vlan for network 9f47de9d-364e-4427-8b37-d5720db906af Nov 15 17:52:48.578946 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.590861 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] For port 33240b16-e01c-400d-9083-3e4dde7e2ccd, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:48.599897 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] For port 33240b16-e01c-400d-9083-3e4dde7e2ccd, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=33240b16-e01c-400d-9083-3e4dde7e2ccd,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:48.606446 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.611567 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.612640 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:48.613282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.674210 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:52:48.675016 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:52:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:48.676583 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] Provisioning complete for port 33240b16-e01c-400d-9083-3e4dde7e2ccd triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:48.679800 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4326818 Nov 15 17:52:48.680857 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59180) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:52:48.682944 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.687076 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Request body: {'subnet': {'network_id': '9f47de9d-364e-4427-8b37-d5720db906af', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-152056715-subnet', 'tenant_id': '6cd9979609f846739626991354158923', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:48.698292 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519a5a9c-3dda-4554-a3d8-dae3cc767863 admin admin] Pushing event updated for resources: {'Network': ['ID=9f47de9d-364e-4427-8b37-d5720db906af,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:48.714023 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 9f47de9d-364e-4427-8b37-d5720db906af details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:52:48.746475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Made reservation on behalf of 6cd9979609f846739626991354158923 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:48.748986 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.767984 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d3002b-cfdf-452c-8cd7-1096bdaa2e37 None None] Pushing event updated for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:48.831930 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:52:48.882757 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.918512 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] For port 33240b16-e01c-400d-9083-3e4dde7e2ccd, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=33240b16-e01c-400d-9083-3e4dde7e2ccd,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:48.922686 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.951965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:48.986428 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd471297-76b2-49f7-8360-b486c2d81870 None None] Pushing event updated for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:49.026533 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Pushing event updated for resources: {'Subnet': ['ID=be29dea8-bad9-4c18-a288-475cbc179c1c,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:49.043001 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Checking segment: {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:49.043492 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Network hostable DHCP agents. Network: 9f47de9d-364e-4427-8b37-d5720db906af, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:52:49.045147 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8bb87018-e333-4524-862e-eeaf02242ecb None None] Provisioning complete for port 33240b16-e01c-400d-9083-3e4dde7e2ccd triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:49.045382 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8bb87018-e333-4524-862e-eeaf02242ecb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:49.062504 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Network 9f47de9d-364e-4427-8b37-d5720db906af is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:52:49.075245 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 9f47de9d-364e-4427-8b37-d5720db906af) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:49.079548 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:49.080162 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:49.085623 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '33240b16-e01c-400d-9083-3e4dde7e2ccd', 'name': '', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'mac_address': 'fa:16:3e:fa:fc:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:43Z', 'updated_at': '2021-11-15T17:52:48Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'subnets': [{'id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:52:49.095088 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a35875fe-20c3-4cc1-8ca7-8ac2f4889cd3 None None] Network 9f47de9d-364e-4427-8b37-d5720db906af requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:49.106653 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-43edafbe-9803-4977-b9d6-c863b1c956df admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4240038 Nov 15 17:52:49.114849 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef44fd7-4b22-409e-b9b1-44002eb23007 None None] The sync data for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi is: [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:44Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '33240b16-e01c-400d-9083-3e4dde7e2ccd', 'name': '', 'network_id': '59245f04-b934-41a1-962b-b90d1d4fd2a7', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'mac_address': 'fa:16:3e:fa:fc:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:43Z', 'updated_at': '2021-11-15T17:52:48Z', 'revision_number': 4, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'subnets': [{'id': 'f5225772-6a11-4da0-ae44-6f3385feeb4a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:52:49.277077 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4852ca42-942c-47ca-bdc5-a044b78091dc None None] Network 9f47de9d-364e-4427-8b37-d5720db906af requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:52:49.504948 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d95240a-ccfa-4ed4-9a44-c87e35b3805e up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:49.562043 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:49.562401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:49.656775 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 33240b16-e01c-400d-9083-3e4dde7e2ccd up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:49.723899 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 33240b16-e01c-400d-9083-3e4dde7e2ccd triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:49.724457 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:50.978242 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-f7644203-6372-4dd7-9deb-b0dc4a1946d1 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:50.979868 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-f7644203-6372-4dd7-9deb-b0dc4a1946d1 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 813 time: 0.1093557 Nov 15 17:52:50.995949 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-3bf99e19-8094-477d-8707-1c494cb93d0b tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/quotas/6cd9979609f846739626991354158923 HTTP/1.1" status: 200 len: 375 time: 0.0101185 Nov 15 17:52:51.026982 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-1c9cf4d1-856d-4342-a960-3552f05aed57 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0258708 Nov 15 17:52:51.117813 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-6ccbcb42-2ead-432c-be89-9fb0b7aa1627 service neutron] 10.222.0.31 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835145 Nov 15 17:52:51.224602 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-9f2c5e54-aed6-4308-91ff-46a5e97d77bc service neutron] 10.222.0.31 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1000690 Nov 15 17:52:51.383633 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-54e93708-85e6-4fca-907f-2d4c85efedb2 req-99c4cd4b-70ee-4c03-b7ba-876ccaa020e7 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 210 time: 0.0266492 Nov 15 17:52:52.334606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:52.474864 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-55b5a3c5-7691-4ac3-806c-9d92ad39e4f5 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:52.476443 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-55b5a3c5-7691-4ac3-806c-9d92ad39e4f5 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 813 time: 0.1208088 Nov 15 17:52:52.485999 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-77e35a85-7d24-4645-b64b-4d7cad7361a4 req-ac62cc72-7912-43eb-973e-76c017ade7fb tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 210 time: 0.0276079 Nov 15 17:52:52.493589 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Request body: {'port': {'device_id': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af', 'admin_state_up': True, 'tenant_id': '6cd9979609f846739626991354158923'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:52.605687 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Made reservation on behalf of 6cd9979609f846739626991354158923 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:52:52.611734 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:52.740640 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Allocated IP 172.20.0.8 (9f47de9d-364e-4427-8b37-d5720db906af/be29dea8-bad9-4c18-a288-475cbc179c1c/0e55f4c6-59af-4793-bbaa-734697e79a75) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:52:52.889962 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:52.925565 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:52.969889 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Network 9f47de9d-364e-4427-8b37-d5720db906af is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:52:52.973140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:52:52.977012 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:52:53.000631 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Pushing event updated for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:53.028282 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:53.028952 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.049209 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-a3650ab8-c8d3-4506-9efa-d86a5c70d74a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5597568 Nov 15 17:52:53.064044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Request body: {'port': {'device_id': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:52:53.124623 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.382830 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e55f4c6-59af-4793-bbaa-734697e79a75 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:52:53.390498 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.402747 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Transition to ACTIVE for port object 0e55f4c6-59af-4793-bbaa-734697e79a75 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:52:53.407922 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.461935 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Pushing event updated for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:53.531965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Attempting to bind port 0e55f4c6-59af-4793-bbaa-734697e79a75 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:52:53.532611 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Attempting to bind port 0e55f4c6-59af-4793-bbaa-734697e79a75 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:52:53.532611 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Attempting to bind port 0e55f4c6-59af-4793-bbaa-734697e79a75 on network 9f47de9d-364e-4427-8b37-d5720db906af {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:53.537600 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Port 0e55f4c6-59af-4793-bbaa-734697e79a75 on network 9f47de9d-364e-4427-8b37-d5720db906af not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:52:53.537903 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Attempting to bind port 0e55f4c6-59af-4793-bbaa-734697e79a75 on network 9f47de9d-364e-4427-8b37-d5720db906af {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:52:53.543121 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:52:53.543454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Checking segment: {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:52:53.543874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Bound using segment: {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:52:53.544295 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Bound port: 0e55f4c6-59af-4793-bbaa-734697e79a75, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:52:53.544647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.607086 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05c687a0-fece-4b54-8808-7bc688ac6ad5 req-d3186ec5-6327-4865-9891-8a68d0ea2e12 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:53.608892 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-05c687a0-fece-4b54-8808-7bc688ac6ad5 req-d3186ec5-6327-4865-9891-8a68d0ea2e12 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 943 time: 0.0533919 Nov 15 17:52:53.609998 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:52:53.613472 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e55f4c6-59af-4793-bbaa-734697e79a75,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:52:53.617775 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.650473 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:53.651127 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:53.655744 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-22691a54-f49f-494f-8190-748c7a742864 service neutron] 10.222.0.48 "PUT /v2.0/ports/0e55f4c6-59af-4793-bbaa-734697e79a75 HTTP/1.1" status: 200 len: 1093 time: 0.5951824 Nov 15 17:52:53.655744 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:52:53.655744 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-722dd806-111f-4715-a6e1-da2c4753187b" -d '{"events": [{"name": "network-changed", "server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:52:53.658252 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-05c687a0-fece-4b54-8808-7bc688ac6ad5 req-9f1f01ed-fac0-412f-bd23-1b8b0b65d371 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430033 Nov 15 17:52:53.682931 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22691a54-f49f-494f-8190-748c7a742864 service neutron] Pushing event updated for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:53.718610 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:52:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3441affe-214c-41b8-b73a-d5938944d8df x-openstack-request-id: req-3441affe-214c-41b8-b73a-d5938944d8df {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:52:53.718890 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:52:53.719136 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-3441affe-214c-41b8-b73a-d5938944d8df {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:52:53.719523 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75', 'status': 'completed', 'code': 200} Nov 15 17:52:53.754580 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-f04c3408-e5e0-4281-8d6a-3173466a657d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:53.756212 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-f04c3408-e5e0-4281-8d6a-3173466a657d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 1096 time: 0.0465519 Nov 15 17:52:53.804118 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-cd5f75ca-39e4-401f-9d9c-47524d55ff61 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0e55f4c6-59af-4793-bbaa-734697e79a75 HTTP/1.1" status: 200 len: 217 time: 0.0337541 Nov 15 17:52:53.857199 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-c5a78d9d-c9f2-48de-ac09-c9e4811a88fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:53.858657 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-c5a78d9d-c9f2-48de-ac09-c9e4811a88fe service neutron] 10.222.0.48 "GET /v2.0/subnets?id=be29dea8-bad9-4c18-a288-475cbc179c1c HTTP/1.1" status: 200 len: 853 time: 0.0445187 Nov 15 17:52:53.895577 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-64eead5b-aa13-402d-997f-a654e499427b service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=9f47de9d-364e-4427-8b37-d5720db906af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272000 Nov 15 17:52:53.993520 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-2343650b-dcd9-4350-b43f-60670af4a856 service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869458 Nov 15 17:52:54.094173 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-267d4cfc-c540-4520-88a1-79a2aabae89b req-9173d7ba-dc22-4dfd-9200-0e80e24ea1b5 service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0919688 Nov 15 17:52:54.202180 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722dd806-111f-4715-a6e1-da2c4753187b req-2ace7177-6fda-415c-b336-f3194828d206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:54.203714 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-2ace7177-6fda-415c-b336-f3194828d206 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 1096 time: 0.0417292 Nov 15 17:52:54.303238 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722dd806-111f-4715-a6e1-da2c4753187b req-800d46f9-0413-4d01-b5dc-6de81584c324 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:54.304759 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-800d46f9-0413-4d01-b5dc-6de81584c324 service neutron] 10.222.0.48 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 914 time: 0.0923955 Nov 15 17:52:54.348320 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-4a6ad4e4-b526-43f4-bcaf-7ad8f683ad89 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0e55f4c6-59af-4793-bbaa-734697e79a75 HTTP/1.1" status: 200 len: 217 time: 0.0331256 Nov 15 17:52:54.405105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722dd806-111f-4715-a6e1-da2c4753187b req-dd53fef4-9378-45d3-bcb0-45488e0d2e2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:54.406592 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-dd53fef4-9378-45d3-bcb0-45488e0d2e2a service neutron] 10.222.0.48 "GET /v2.0/subnets?id=be29dea8-bad9-4c18-a288-475cbc179c1c HTTP/1.1" status: 200 len: 853 time: 0.0454626 Nov 15 17:52:54.440299 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-4ac686c5-e200-45a7-83c1-b6a761ff400e service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=9f47de9d-364e-4427-8b37-d5720db906af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238183 Nov 15 17:52:54.540801 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-2bdf1058-b891-4b4d-a3f4-faec3cf76b72 service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915174 Nov 15 17:52:54.643315 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-722dd806-111f-4715-a6e1-da2c4753187b req-16200355-7077-4bb9-8633-0f3cccf3ea1d service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930774 Nov 15 17:52:54.799439 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce25d775-21ef-489c-9e32-0350059b8afd req-20f776e6-5b50-4e92-97dd-c44bc0e28d13 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:54.800922 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ce25d775-21ef-489c-9e32-0350059b8afd req-20f776e6-5b50-4e92-97dd-c44bc0e28d13 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 943 time: 0.0625954 Nov 15 17:52:54.848757 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ce25d775-21ef-489c-9e32-0350059b8afd req-b94b9393-ab95-408d-b64e-13fabba7dc9e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418193 Nov 15 17:52:55.971082 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b280ce-262c-4801-83aa-a77966217a00 req-cefa5a24-26ea-46b8-a211-c4bea0b053c6 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:55.972619 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59b280ce-262c-4801-83aa-a77966217a00 req-cefa5a24-26ea-46b8-a211-c4bea0b053c6 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 943 time: 0.0509541 Nov 15 17:52:55.984692 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e55f4c6-59af-4793-bbaa-734697e79a75 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:52:56.029864 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59b280ce-262c-4801-83aa-a77966217a00 req-6317245f-d430-4f80-9cb5-a83b641b1b0f tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511966 Nov 15 17:52:56.090348 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e55f4c6-59af-4793-bbaa-734697e79a75,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:56.101656 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '0e55f4c6-59af-4793-bbaa-734697e79a75', 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af', 'port_id': '0e55f4c6-59af-4793-bbaa-734697e79a75', 'mac_address': 'fa:16:3e:03:6f:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 436, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be29dea8-bad9-4c18-a288-475cbc179c1c', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:52:56.143330 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:56.157218 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e55f4c6-59af-4793-bbaa-734697e79a75 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:52:56.178792 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e55f4c6-59af-4793-bbaa-734697e79a75,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:56.184645 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:56.230357 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:56.450903 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['0e55f4c6-59af-4793-bbaa-734697e79a75'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:52:57.150231 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b06a362-f2e3-4ad8-9669-9cf7f9c2389e req-6f91002f-b365-4cc0-ace4-dd331ddbafc6 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:57.151723 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b06a362-f2e3-4ad8-9669-9cf7f9c2389e req-6f91002f-b365-4cc0-ace4-dd331ddbafc6 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 944 time: 0.0556290 Nov 15 17:52:57.200818 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b06a362-f2e3-4ad8-9669-9cf7f9c2389e req-bf01c2bd-a290-4741-8a1e-4b6f6f9adfbc tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429778 Nov 15 17:52:58.012659 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e55f4c6-59af-4793-bbaa-734697e79a75 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:52:58.066553 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 0e55f4c6-59af-4793-bbaa-734697e79a75 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:52:58.070357 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 0e55f4c6-59af-4793-bbaa-734697e79a75 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:52:58.070724 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:58.153044 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:58.177103 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:52:58.179375 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da64d848-64ee-403c-ad8e-674d2f57d6d8" -d '{"events": [{"server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "name": "network-vif-plugged", "status": "completed", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:52:58.192313 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e55f4c6-59af-4793-bbaa-734697e79a75,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:52:58.197941 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:52:58.225491 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:52:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f7ef650-e1b2-43cb-9db6-a275f811b5d1 x-openstack-request-id: req-2f7ef650-e1b2-43cb-9db6-a275f811b5d1 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:52:58.225808 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "name": "network-vif-plugged", "status": "completed", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:52:58.226130 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-2f7ef650-e1b2-43cb-9db6-a275f811b5d1 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:52:58.226455 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75', 'code': 200} Nov 15 17:52:58.257193 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:52:58.330639 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a1f21c-fe58-4a48-881f-b0fec0aed2d8 req-63c37d04-9de5-4319-9917-6154d46ec2fc tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:58.332310 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-94a1f21c-fe58-4a48-881f-b0fec0aed2d8 req-63c37d04-9de5-4319-9917-6154d46ec2fc tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0522380 Nov 15 17:52:58.382216 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-94a1f21c-fe58-4a48-881f-b0fec0aed2d8 req-36e0789c-3708-4ce7-a10f-5ac767d40f03 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436583 Nov 15 17:52:58.411718 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f3b092-9ea0-4bd5-8fc4-1e79341c6309 req-201196ae-2822-4cb6-94f6-ac96d285ee9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:58.413252 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f0f3b092-9ea0-4bd5-8fc4-1e79341c6309 req-201196ae-2822-4cb6-94f6-ac96d285ee9e service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 1098 time: 0.0414579 Nov 15 17:52:58.467320 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f0f3b092-9ea0-4bd5-8fc4-1e79341c6309 req-303543f2-177c-462d-b808-b14f4e6b24ab service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455959 Nov 15 17:52:59.512297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae797ff7-25cd-4989-be96-ee954825dcbc req-d3e9220b-165c-406f-b55f-ac576af1f688 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:52:59.514282 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ae797ff7-25cd-4989-be96-ee954825dcbc req-d3e9220b-165c-406f-b55f-ac576af1f688 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0575199 Nov 15 17:52:59.560152 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ae797ff7-25cd-4989-be96-ee954825dcbc req-580b07fd-6908-4308-846b-01a1cb6a3b14 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403204 Nov 15 17:53:00.685892 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b098db0-c116-40f7-a24e-56cdfacafad2 req-ad932b61-5ab9-46d0-a387-76e333db4ab2 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:00.687551 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0b098db0-c116-40f7-a24e-56cdfacafad2 req-ad932b61-5ab9-46d0-a387-76e333db4ab2 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0611904 Nov 15 17:53:00.737861 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0b098db0-c116-40f7-a24e-56cdfacafad2 req-546e5bb0-e34b-4a5e-8ba9-dace440ee7f9 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440600 Nov 15 17:53:00.779112 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ffd5ee74-e85b-460e-bba0-b456eef067bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:03.050509 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:53:03.083377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4813da6f-d87f-4648-bce2-b6df2eaf9338 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:04.469776 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:05.038525 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-afbfc637-c5ef-4917-a858-88046c5cb362 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1950932927&fields=id&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 267 time: 0.0469317 Nov 15 17:53:05.155133 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-91164e54-903f-4ad8-a1b8-e3677e098203 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:05.156675 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-91164e54-903f-4ad8-a1b8-e3677e098203 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1094797 Nov 15 17:53:05.172735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-a78a28c4-0e32-4a86-97fb-5eec8b380ecb tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/quotas/02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 375 time: 0.0099874 Nov 15 17:53:05.224878 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-e0336b1a-393a-434a-9207-29746725919b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0466597 Nov 15 17:53:05.332433 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-53e0c800-7bdc-406e-8fa0-b2826a243624 service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944171 Nov 15 17:53:05.434019 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-e290d779-f0c6-4ba3-8d60-411a5af993ff service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946686 Nov 15 17:53:05.573813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:05.730942 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6a0f0801-8728-4a66-b7cb-97cd03ef04fe req-e6345d92-33cd-4dce-ad4c-aa339b17d95c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 210 time: 0.0303793 Nov 15 17:53:06.663227 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:06.784369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-86f040ac-15c6-4b1b-9ee7-1981a9f752ba tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:06.786021 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-86f040ac-15c6-4b1b-9ee7-1981a9f752ba tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1080654 Nov 15 17:53:06.826160 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-afb90d64-a8ac-4c23-a536-35481188ea45 req-40dfd9f7-ad3b-45b0-ae8c-122dd6a8e295 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 210 time: 0.0262320 Nov 15 17:53:06.862659 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-34b73075-66f1-4fa6-bbcd-5e742f72bda0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 380 time: 0.0651159 Nov 15 17:53:06.874721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'port': {'device_id': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'admin_state_up': True, 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'security_groups': ['d1957e86-4d23-410d-832b-14bd8f646ece']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:06.986025 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Made reservation on behalf of 02ec9c6dcc7d48c5b52b4ee146d42ec8 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:53:06.989982 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.119361 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.20.0.4 (225bbc0e-9530-4b54-be05-d3092f2f1bf3/4800e8bb-9314-46c0-b919-995a65894f5c/b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:07.268589 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.305481 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.348630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:07.353864 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:07.357553 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:07.384229 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:07.412283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:07.412927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.437674 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-702fd79e-2427-4c46-9b16-ab27fb19b581 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5669296 Nov 15 17:53:07.457455 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Request body: {'port': {'device_id': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:07.518721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.553150 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-7c82c150-b5a8-42f7-8489-06d44521fbf7 None None] Provisioning complete for port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:07.553541 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7c82c150-b5a8-42f7-8489-06d44521fbf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.587827 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-7c82c150-b5a8-42f7-8489-06d44521fbf7 None None] Port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:53:07.778770 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:07.786541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.798493 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Transition to ACTIVE for port object b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:53:07.804795 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.877609 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Pushing event updated for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:07.933811 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Attempting to bind port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:53:07.934142 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Attempting to bind port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:53:07.934466 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Attempting to bind port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:07.938863 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:53:07.939184 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Attempting to bind port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:07.944421 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 52, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:53:07.944816 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:53:07.945228 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Bound using segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:53:07.945628 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Bound port: b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:53:07.945977 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:07.960681 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792cc68-0df1-47f3-ab31-54b743b87479 req-581141c5-3d92-4052-a2b5-a0d57b635657 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:07.963006 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a792cc68-0df1-47f3-ab31-54b743b87479 req-581141c5-3d92-4052-a2b5-a0d57b635657 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.0536754 Nov 15 17:53:08.013281 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:53:08.016708 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:53:08.020503 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a792cc68-0df1-47f3-ab31-54b743b87479 req-b22c47f1-6a5c-4be4-ac06-bee3120c993e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512009 Nov 15 17:53:08.024739 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:08.065788 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:08.066507 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:08.067913 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] 10.222.0.48 "PUT /v2.0/ports/b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 1093 time: 0.6164227 Nov 15 17:53:08.068368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:08.070592 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f46eb09-d423-4c5e-bdb0-67dd48963d72" -d '{"events": [{"name": "network-changed", "server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:08.093438 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca1dcfe-63a0-44de-bb7a-3bc3c863a2d6 service neutron] Pushing event updated for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:08.122509 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35f494dc-4443-40ab-91d4-12384fe67184 x-openstack-request-id: req-35f494dc-4443-40ab-91d4-12384fe67184 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:08.122877 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:08.123171 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-35f494dc-4443-40ab-91d4-12384fe67184 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:08.123624 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'status': 'completed', 'code': 200} Nov 15 17:53:08.168451 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-c5595e21-d392-43f6-bf8d-1d500d70bcda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:08.169962 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-c5595e21-d392-43f6-bf8d-1d500d70bcda service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1096 time: 0.0434859 Nov 15 17:53:08.217766 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-4ff1a3a9-6a82-40d3-9b8e-63f19cba8c5a service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 217 time: 0.0362046 Nov 15 17:53:08.286657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-9d21c510-3da4-4152-9319-d8879de24ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:08.288060 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-9d21c510-3da4-4152-9319-d8879de24ae4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0530322 Nov 15 17:53:08.343017 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-f8695192-a127-48d3-8ce6-8e800e76e120 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:08.344723 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-f8695192-a127-48d3-8ce6-8e800e76e120 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432572 Nov 15 17:53:08.441311 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-1f8fbad9-cbe4-4864-b1da-a9a2a2fb84ba service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888693 Nov 15 17:53:08.544994 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-32810763-2a63-4aeb-afd1-1f756ee1fb4b req-5b44fa04-f1da-4ed3-bfb1-df8ceec9438b service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853965 Nov 15 17:53:08.649919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-0d723447-bb60-4cbf-8f9c-bb9b338c535c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:08.651503 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-0d723447-bb60-4cbf-8f9c-bb9b338c535c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1096 time: 0.0434542 Nov 15 17:53:08.999654 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-5b24c908-2c99-45a6-bfb9-4761be4ba3e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:09.001173 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-5b24c908-2c99-45a6-bfb9-4761be4ba3e0 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.3401351 Nov 15 17:53:09.047174 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-cd65a01f-d49f-4fbd-a044-a284dfc5f568 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 217 time: 0.0363634 Nov 15 17:53:09.097566 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-22bd1335-99ec-4086-acba-62564d7c1e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:09.099055 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-22bd1335-99ec-4086-acba-62564d7c1e8a service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0448706 Nov 15 17:53:09.143613 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d8d4ab-a62a-4f8a-9a99-d219042869c5 req-388876a0-8999-4abb-90a0-b0c301cb290f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:09.145294 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-92d8d4ab-a62a-4f8a-9a99-d219042869c5 req-388876a0-8999-4abb-90a0-b0c301cb290f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.0495479 Nov 15 17:53:09.150776 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-e29abc62-c750-4cb3-8589-8d9fb65df572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:09.152288 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-e29abc62-c750-4cb3-8589-8d9fb65df572 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444510 Nov 15 17:53:09.200651 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-92d8d4ab-a62a-4f8a-9a99-d219042869c5 req-2e05e4dc-a576-411a-9f1c-77e6b3843750 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487423 Nov 15 17:53:09.244067 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-9a98040f-cf00-4fae-825e-5e34646745d8 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833240 Nov 15 17:53:09.345047 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2f46eb09-d423-4c5e-bdb0-67dd48963d72 req-0a692b4b-94c4-44bd-aa52-efb9b7e4d0c5 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934725 Nov 15 17:53:10.324205 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0cba7ed-580c-4022-b55f-bae6137716e6 req-77a69847-cc32-49da-8139-e794842ba37a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:10.325673 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0cba7ed-580c-4022-b55f-bae6137716e6 req-77a69847-cc32-49da-8139-e794842ba37a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.0527730 Nov 15 17:53:10.376751 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0cba7ed-580c-4022-b55f-bae6137716e6 req-71f7f9f0-3cce-4d0b-a4db-ee3da5e7eb4a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447211 Nov 15 17:53:11.502446 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c470dbf2-aa31-4226-8c42-0a88f33417d9 req-3b4392a1-f5db-40a5-96bb-59bae54ace5c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:11.503930 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c470dbf2-aa31-4226-8c42-0a88f33417d9 req-3b4392a1-f5db-40a5-96bb-59bae54ace5c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.0492716 Nov 15 17:53:11.554652 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c470dbf2-aa31-4226-8c42-0a88f33417d9 req-d817892d-a25b-4718-976a-8f242ee3d303 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445476 Nov 15 17:53:12.795039 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9481ff9-f099-4f04-a0ad-ad2dbdb10a72 req-d880578b-27ac-4514-80c5-25a5f51cc570 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:12.796584 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9481ff9-f099-4f04-a0ad-ad2dbdb10a72 req-d880578b-27ac-4514-80c5-25a5f51cc570 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.1700618 Nov 15 17:53:12.846543 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9481ff9-f099-4f04-a0ad-ad2dbdb10a72 req-2c786836-fdd2-4e8f-83ab-1f962118d09c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437548 Nov 15 17:53:14.034371 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752e77f3-6211-4347-a1f6-18a9ac031a0e req-302958ab-8987-4e0d-96dd-b0ae0f987776 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:14.035884 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-752e77f3-6211-4347-a1f6-18a9ac031a0e req-302958ab-8987-4e0d-96dd-b0ae0f987776 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.1015728 Nov 15 17:53:14.091949 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-752e77f3-6211-4347-a1f6-18a9ac031a0e req-81a1d65a-c712-4f23-bbfa-13625fe9fa18 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499504 Nov 15 17:53:15.229644 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34514ad-82e2-4d43-8ac8-2d3beb721213 req-45393af3-b7b2-40fe-8163-4234b3274d1d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:15.231273 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e34514ad-82e2-4d43-8ac8-2d3beb721213 req-45393af3-b7b2-40fe-8163-4234b3274d1d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 943 time: 0.0597343 Nov 15 17:53:15.289759 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e34514ad-82e2-4d43-8ac8-2d3beb721213 req-9b60bc62-9132-4ea3-a453-710aa7e9c8d4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497947 Nov 15 17:53:16.080002 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:53:16.185088 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:16.195814 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'port_id': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'mac_address': 'fa:16:3e:c0:97:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 430, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:53:16.234669 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:16.247506 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:16.266561 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:16.273152 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:16.319245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:16.419401 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b0e129-61a9-48b3-adc8-95416f535b87 req-779b89b5-d480-421c-886b-370ea7421b49 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:16.420913 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34b0e129-61a9-48b3-adc8-95416f535b87 req-779b89b5-d480-421c-886b-370ea7421b49 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 944 time: 0.0615890 Nov 15 17:53:16.475799 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-34b0e129-61a9-48b3-adc8-95416f535b87 req-7ccfb4d3-88bf-4fd1-844e-822de2cc35c9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467381 Nov 15 17:53:16.603144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:53:17.603055 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063d22ce-58a0-401a-aa48-2ee01ba8229f req-77c7c661-ff49-4d2c-a28b-2f6ca8b2973f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:17.604522 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-063d22ce-58a0-401a-aa48-2ee01ba8229f req-77c7c661-ff49-4d2c-a28b-2f6ca8b2973f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 944 time: 0.0552621 Nov 15 17:53:17.653669 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-063d22ce-58a0-401a-aa48-2ee01ba8229f req-6575fa49-08d6-41b0-9661-bdeeaa4df994 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421205 Nov 15 17:53:18.102601 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:53:18.155816 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:53:18.160600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:18.160977 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:18.244868 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:18.268722 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:18.270972 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3f9e76e-54c8-452c-94e5-3078a6d63731" -d '{"events": [{"server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "name": "network-vif-plugged", "status": "completed", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:18.286010 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:18.290767 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:18.318465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f3e2ca7-e0e5-4c9a-9415-b27aeb16233c x-openstack-request-id: req-2f3e2ca7-e0e5-4c9a-9415-b27aeb16233c {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:18.318465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "name": "network-vif-plugged", "status": "completed", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:18.318465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-2f3e2ca7-e0e5-4c9a-9415-b27aeb16233c {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:18.318465 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'code': 200} Nov 15 17:53:18.344036 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:18.556607 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac614212-91da-437d-963f-29541f22cca2 req-fc21e3de-9c0c-4f11-8457-bb9c55be8a5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:18.558012 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ac614212-91da-437d-963f-29541f22cca2 req-fc21e3de-9c0c-4f11-8457-bb9c55be8a5b service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1098 time: 0.0408447 Nov 15 17:53:18.621301 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ac614212-91da-437d-963f-29541f22cca2 req-da1e3bec-11ed-4af5-8520-3dbc3f99b735 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410342 Nov 15 17:53:18.777480 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f61e52-3378-4fcf-8d64-1098f0d98776 req-b05bf63d-4108-4772-a1c6-1cc689810e1f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:18.779061 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f61e52-3378-4fcf-8d64-1098f0d98776 req-b05bf63d-4108-4772-a1c6-1cc689810e1f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0531075 Nov 15 17:53:18.835815 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f61e52-3378-4fcf-8d64-1098f0d98776 req-4070aba0-a423-4466-8d10-23a22db457fe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505168 Nov 15 17:53:19.968114 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21d9ca9-2501-4ff6-9a30-56db670d7f23 req-b9084f29-c262-4d02-9f49-f42a15781249 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:19.969586 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c21d9ca9-2501-4ff6-9a30-56db670d7f23 req-b9084f29-c262-4d02-9f49-f42a15781249 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0594976 Nov 15 17:53:20.025462 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c21d9ca9-2501-4ff6-9a30-56db670d7f23 req-afcf818c-2ed6-4ea3-930b-417ecb084935 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483129 Nov 15 17:53:20.154670 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccfecd1-caeb-4d4a-a6ef-4b1172c54d77 req-f5c42a59-966f-41cf-af06-efafe5040884 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:20.156176 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bccfecd1-caeb-4d4a-a6ef-4b1172c54d77 req-f5c42a59-966f-41cf-af06-efafe5040884 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0631499 Nov 15 17:53:20.204687 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bccfecd1-caeb-4d4a-a6ef-4b1172c54d77 req-3a0a56c4-1efa-41d4-bcd9-2bbe3f3094b7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424821 Nov 15 17:53:20.227269 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59464) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:20.390248 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fb0db7d-491c-45fe-a239-12f4f5b8c0b9 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:20.391803 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2fb0db7d-491c-45fe-a239-12f4f5b8c0b9 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1093 time: 0.1635890 Nov 15 17:53:20.394995 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59470) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:20.399316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'port_id': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address': '172.20.0.4'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:20.423477 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:20.535206 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:20.639549 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.27.0.206 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/2c7cfb51-8d6d-4ea0-afef-4776c8aa32df) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:20.748282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:20.791786 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:20.836756 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:20.839566 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:20.843423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:20.848674 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=2c7cfb51-8d6d-4ea0-afef-4776c8aa32df,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:20.880767 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.881142 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.881482 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.881798 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.882120 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.882440 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.882766 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.883091 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.883444 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.883793 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.884097 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:20.884423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:21.204976 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:21.276751 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:21.395665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2a9502-6105-4624-ae97-07106a5c9f87 req-4ead8995-dff8-4dfa-b92b-c2d44020891d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:21.397068 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f2a9502-6105-4624-ae97-07106a5c9f87 req-4ead8995-dff8-4dfa-b92b-c2d44020891d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0983441 Nov 15 17:53:21.478478 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f2a9502-6105-4624-ae97-07106a5c9f87 req-81f1df9f-1d00-4ddb-841b-ff1ea5833dac tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753317 Nov 15 17:53:21.505628 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:21.511330 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:21.565206 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-459555c6-064e-44e4-9662-079544d63296 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0435929 Nov 15 17:53:21.579856 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=2c7cfb51-8d6d-4ea0-afef-4776c8aa32df,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:21.587973 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:21.659114 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f565718-8a7c-459f-a8a3-86b026296656 req-47225749-df9d-4018-a22d-b839806ebfd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:21.661049 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-47225749-df9d-4018-a22d-b839806ebfd3 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 1099 time: 0.0449579 Nov 15 17:53:21.778982 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f565718-8a7c-459f-a8a3-86b026296656 req-25d72a57-75db-486f-a98f-461fc2eb70fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:21.780504 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-25d72a57-75db-486f-a98f-461fc2eb70fa service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.0894680 Nov 15 17:53:21.854508 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-1998ea30-ad0e-479b-b7af-8e2813d86599 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 200 len: 1001 time: 0.0653408 Nov 15 17:53:21.905096 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 9555c4a5-a365-45f2-8502-dc3118e496a2 associated. External IP: 172.27.0.206, port: b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25. Nov 15 17:53:21.911351 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f565718-8a7c-459f-a8a3-86b026296656 req-57c6ddf0-2147-4473-829b-03dab91badcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:21.912785 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-57c6ddf0-2147-4473-829b-03dab91badcc service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0473175 Nov 15 17:53:21.960340 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f565718-8a7c-459f-a8a3-86b026296656 req-812ed7dd-7cb7-476b-9958-2ccfb1bcdbb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:21.962118 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-812ed7dd-7cb7-476b-9958-2ccfb1bcdbb6 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0406351 Nov 15 17:53:22.060693 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-d51dead5-e1d3-4b0a-b8fe-89a1749c78b1 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893445 Nov 15 17:53:22.119652 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:53:22.168050 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5f565718-8a7c-459f-a8a3-86b026296656 req-fe3c44b4-c156-4e0f-9b16-bf94e9e88008 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969920 Nov 15 17:53:22.240617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:53:22.250705 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:53:22.258844 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:22.260502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:22.261192 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:22.284745 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2a886c55-ea71-4616-abb6-a385920462a7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8887460 Nov 15 17:53:22.285322 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:22.287601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44" -d '{"events": [{"name": "network-changed", "server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:22.322276 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e295da55-40ad-4a5e-87cf-c3e511203fa8 x-openstack-request-id: req-e295da55-40ad-4a5e-87cf-c3e511203fa8 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:22.322556 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:22.322798 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e295da55-40ad-4a5e-87cf-c3e511203fa8 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:22.323197 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'status': 'completed', 'code': 200} Nov 15 17:53:22.352115 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:22.378346 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:22.398004 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-15a8d8c9-f585-4e4c-8c3a-22f2aa4e629a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:22.399482 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-15a8d8c9-f585-4e4c-8c3a-22f2aa4e629a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1098 time: 0.0391879 Nov 15 17:53:22.493822 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-38f66f40-61d7-4592-a1db-e5b0ba597e04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:22.495287 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-38f66f40-61d7-4592-a1db-e5b0ba597e04 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0868533 Nov 15 17:53:22.574054 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-d953425b-8135-425b-a901-bd5aece47366 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 999 time: 0.0697474 Nov 15 17:53:22.623929 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44088277-1381-4cd7-b870-d65ce5986424 req-837c1ed1-7268-43f9-92be-c5a61a08ab5e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:22.625481 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44088277-1381-4cd7-b870-d65ce5986424 req-837c1ed1-7268-43f9-92be-c5a61a08ab5e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0591342 Nov 15 17:53:22.642350 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-53796ed8-26e5-4d9c-b257-0b6e49159307 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:22.643848 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-53796ed8-26e5-4d9c-b257-0b6e49159307 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0545816 Nov 15 17:53:22.670141 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '9555c4a5-a365-45f2-8502-dc3118e496a2', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.206', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:c0:97:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:21Z', 'updated_at': '2021-11-15T17:53:21Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:22.680335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-44088277-1381-4cd7-b870-d65ce5986424 req-49da5c77-d79d-42b9-8d1b-680fb9995247 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483925 Nov 15 17:53:22.699134 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:53:22.705746 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-2a6e7315-b3f9-4803-8bc0-7f669268aa02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:22.707261 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-2a6e7315-b3f9-4803-8bc0-7f669268aa02 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0513432 Nov 15 17:53:22.708518 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:22.709124 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:22.807681 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-f48e3212-5623-4998-8f0d-e5f6590747a5 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814533 Nov 15 17:53:22.813329 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:22.904442 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4d35f2b9-2366-4d06-b8d8-e127ce8f6a44 req-aefa3c60-bcc0-4ef2-a43e-27bbbe20e648 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854805 Nov 15 17:53:23.036715 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '9555c4a5-a365-45f2-8502-dc3118e496a2', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.206', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:c0:97:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:21Z', 'updated_at': '2021-11-15T17:53:21Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:23.061915 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84ca5a44-47c2-41f9-a6ce-96076de4dc2f None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '9555c4a5-a365-45f2-8502-dc3118e496a2', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.206', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:c0:97:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:21Z', 'updated_at': '2021-11-15T17:53:21Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:53:23.256835 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9db90179-4af9-438d-b4a0-f385c4e9618e None None] New status for floating IP 9555c4a5-a365-45f2-8502-dc3118e496a2: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:53:23.797378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-8de01f99-90a4-4518-bcdc-7e5b1f15e418 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:23.798868 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-8de01f99-90a4-4518-bcdc-7e5b1f15e418 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0494401 Nov 15 17:53:23.802098 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3ddf17-f989-4a66-8046-b0616dfb14f5 req-3a9348a3-6376-49e9-83ff-43a73024b836 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:23.803590 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5b3ddf17-f989-4a66-8046-b0616dfb14f5 req-3a9348a3-6376-49e9-83ff-43a73024b836 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 946 time: 0.0518343 Nov 15 17:53:23.851545 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5b3ddf17-f989-4a66-8046-b0616dfb14f5 req-86e9afe1-830f-4d6a-8492-5a6a2779b4f2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=4763e2ec-c45b-467d-b585-24d2e073d880&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415168 Nov 15 17:53:23.892475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Deleting port 292c8c58-e8da-4843-ba3f-a998315a35b0 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:53:23.892813 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:23.984038 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] For port 292c8c58-e8da-4843-ba3f-a998315a35b0, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=292c8c58-e8da-4843-ba3f-a998315a35b0,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:23.984259 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:24.202241 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:24.202614 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:24.202924 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Floating IP 46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72 disassociated. External IP: 172.27.0.223, port: 292c8c58-e8da-4843-ba3f-a998315a35b0. Nov 15 17:53:24.203291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Calling delete_port for 292c8c58-e8da-4843-ba3f-a998315a35b0 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:53:24.338647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:24.367483 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'Port': ['ID=292c8c58-e8da-4843-ba3f-a998315a35b0,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:24.479404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:53:24.585722 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:53:24.598363 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:53:24.625257 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:24.632270 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] No DVR routers for this DVR port 292c8c58-e8da-4843-ba3f-a998315a35b0 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:53:24.632806 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:24.634754 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:24.649241 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6b41619e-c4bc-486e-a91c-1c5f7fb5ecd1 req-13bcd9ef-4020-4eac-b2dc-ae547bb6a711 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "DELETE /v2.0/ports/292c8c58-e8da-4843-ba3f-a998315a35b0 HTTP/1.1" status: 204 len: 173 time: 0.8430173 Nov 15 17:53:24.649987 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'name': 'network-vif-deleted', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:24.653220 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f878cb8e-bc23-4783-8892-182be15ddeb8" -d '{"events": [{"server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "name": "network-vif-deleted", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:24.718802 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-173105c9-4669-42db-ae8e-17c3e71446c0 x-openstack-request-id: req-173105c9-4669-42db-ae8e-17c3e71446c0 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:24.719215 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea40d6a8-fc98-45a3-a501-937b5f0e46ef", "name": "network-vif-deleted", "tag": "292c8c58-e8da-4843-ba3f-a998315a35b0", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:24.719534 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-173105c9-4669-42db-ae8e-17c3e71446c0 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:24.720058 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea40d6a8-fc98-45a3-a501-937b5f0e46ef', 'name': 'network-vif-deleted', 'tag': '292c8c58-e8da-4843-ba3f-a998315a35b0', 'status': 'completed', 'code': 200} Nov 15 17:53:24.794002 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:24.962294 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e152f415-a11c-4f69-9f45-43feff89558c req-07248a73-3eaf-401e-b1b6-7c44d55d64d3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=ea40d6a8-fc98-45a3-a501-937b5f0e46ef HTTP/1.1" status: 200 len: 210 time: 0.0260403 Nov 15 17:53:24.998258 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:25.026678 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:53:25.035647 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:25.036265 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:25.268895 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:25.484883 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:25.519476 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f5dbad-1016-4e80-89ca-a6603bc018ee None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:53:25.746043 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36a2fd9f-53ce-4a62-8738-b01c17bb9a91 None None] New status for floating IP 46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:53:26.056425 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59532) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:26.107688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 292c8c58-e8da-4843-ba3f-a998315a35b0 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:53:26.128528 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 292c8c58-e8da-4843-ba3f-a998315a35b0 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:53:26.128903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.129319 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 292c8c58-e8da-4843-ba3f-a998315a35b0 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:53:26.157774 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.211852 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.214578 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.216327 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "DELETE /v2.0/security-groups/4763e2ec-c45b-467d-b585-24d2e073d880 HTTP/1.1" status: 204 len: 168 time: 0.1589050 Nov 15 17:53:26.219194 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59536) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:26.230195 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d03b070-af90-4b7c-90c3-d9e9258a6f99 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4763e2ec-c45b-467d-b585-24d2e073d880,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:26.233405 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.api.v2.resource [None req-9f7545db-f652-4bd8-be65-d698bd39e7f4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] show failed (client error): The resource could not be found. Nov 15 17:53:26.235747 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-9f7545db-f652-4bd8-be65-d698bd39e7f4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups/4763e2ec-c45b-467d-b585-24d2e073d880 HTTP/1.1" status: 404 len: 347 time: 0.0141425 Nov 15 17:53:26.237222 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59538) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:26.363368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Deleting port 239541d0-8ab6-4c43-b1ad-aa695f376731 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:53:26.363729 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.442093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.442423 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.454904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Calling delete_port for 239541d0-8ab6-4c43-b1ad-aa695f376731 owned by network:floatingip {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:53:26.605403 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.632051 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'Port': ['ID=239541d0-8ab6-4c43-b1ad-aa695f376731,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:26.658317 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b359cc-cc2f-4bf0-a136-5366696ea54e req-227c2850-e0fd-4b15-bce1-9d44c4e05257 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:26.666416 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-62b359cc-cc2f-4bf0-a136-5366696ea54e req-227c2850-e0fd-4b15-bce1-9d44c4e05257 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0653403 Nov 15 17:53:26.696092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.698672 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:26.699928 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b729a866-135d-42cb-89a4-eaec974f69f5 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "DELETE /v2.0/floatingips/46e0bc7c-9a0b-4f1c-83a5-58ef27f6be72 HTTP/1.1" status: 204 len: 168 time: 0.4614706 Nov 15 17:53:26.714062 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-62b359cc-cc2f-4bf0-a136-5366696ea54e req-0c9b2fd8-e004-4a52-aa84-b8d95d0435fd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464373 Nov 15 17:53:26.955195 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59550) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:26.959917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1080131607', 'description': 'tempest-description--1294792134'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:26.982167 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.054307 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.060480 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.094085 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.095300 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1390426 Nov 15 17:53:27.097286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39187463-bfaa-4173-b8dd-7dd3736987f3 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=52caeb19-493c-4fbf-a742-97c911021216,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:27.098409 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59552) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:27.103605 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group_rule': {'security_group_id': '52caeb19-493c-4fbf-a742-97c911021216', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:27.132446 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.185807 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.191210 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.208683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb5a9dc4-e5be-4aa0-821a-75fe960b50e2,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:27.220764 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.222096 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-35488ff4-5952-4154-b8c6-caf5a975a93c tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1221101 Nov 15 17:53:27.224715 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59556) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:27.229022 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'security_group_rule': {'security_group_id': '52caeb19-493c-4fbf-a742-97c911021216', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:27.256290 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.312009 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.318006 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.336847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff058fbc-bc4a-4cb7-9153-d6bcc341b66b,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:27.342138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.343365 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5e18ae96-5a47-4228-a665-d7f7fd722a09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1176903 Nov 15 17:53:27.346567 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59558) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:27.350937 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:27.373704 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.473415 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.580210 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Allocated IP 172.27.0.11 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/27a4afc1-13df-438c-a76f-dd0c4b05d7ac) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:27.692252 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.730272 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.768897 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:27.773607 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:27.777112 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:27.814996 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=27a4afc1-13df-438c-a76f-dd0c4b05d7ac,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:27.886864 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a53b863-d695-490d-a698-f3be464e4891 req-9febcede-9f8a-4b26-8db9-a2df618e0437 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:27.888499 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4a53b863-d695-490d-a698-f3be464e4891 req-9febcede-9f8a-4b26-8db9-a2df618e0437 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0849075 Nov 15 17:53:27.916860 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:27.969345 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4a53b863-d695-490d-a698-f3be464e4891 req-60f177cc-d31d-4412-b70c-6b59a2a94a71 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0743413 Nov 15 17:53:27.971816 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:28.120273 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:28.126128 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:28.192928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=27a4afc1-13df-438c-a76f-dd0c4b05d7ac,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:28.205005 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:28.222618 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:28.224772 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-52da5716-de99-4dd6-b9ea-e0f02b9b8b1f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8766134 Nov 15 17:53:28.432162 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-0a8a20b6-4456-4195-81d3-7dabc22a05cb tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1080131607&fields=id&tenant_id=230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 267 time: 0.0433292 Nov 15 17:53:28.542853 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-43220be5-62b4-49b2-82bb-151543926ba2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:28.544268 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-43220be5-62b4-49b2-82bb-151543926ba2 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 811 time: 0.1050191 Nov 15 17:53:28.559164 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-b5aa8578-f49b-4751-b4a5-8a67439c7e4e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/quotas/230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 375 time: 0.0092227 Nov 15 17:53:28.612680 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-2af72cb6-be3c-4805-9325-d4406d5d21b9 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0482705 Nov 15 17:53:28.761633 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-ce6f74f0-b42d-403a-8db7-d5e1026aedbe service neutron] 10.222.0.31 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1322451 Nov 15 17:53:28.853567 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-2e6c821a-f904-4186-a81e-8ec7e0858dec service neutron] 10.222.0.31 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839281 Nov 15 17:53:29.014648 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-17b4174a-8eb2-4e58-93c7-742b1c2c3973 req-0d1302d4-cd93-4a06-97e1-5c7f0bda6e42 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 210 time: 0.0275545 Nov 15 17:53:29.098332 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadd8aa2-5380-49a0-b5c0-b033bbaacf2e req-c621ba07-b444-46ce-aa55-25677f2cb282 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:29.099843 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fadd8aa2-5380-49a0-b5c0-b033bbaacf2e req-c621ba07-b444-46ce-aa55-25677f2cb282 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0531690 Nov 15 17:53:29.152008 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fadd8aa2-5380-49a0-b5c0-b033bbaacf2e req-d3c16694-08ef-4a5d-a286-c1760508120a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435753 Nov 15 17:53:30.113496 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1cde6326-0a5e-4d0d-a78e-319126612d2a req-f782e91c-825d-42ea-bdac-3e74b6c01e54 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 210 time: 0.0269589 Nov 15 17:53:30.144885 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-6a0ca7b8-7548-4025-bf6b-df77aff8f4e7 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:30.146336 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-6a0ca7b8-7548-4025-bf6b-df77aff8f4e7 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 811 time: 0.1091607 Nov 15 17:53:30.213095 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-1408e817-b3cd-429b-a628-ff0c003f78bd tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=230fd761d538456998d7b335d14192ff HTTP/1.1" status: 200 len: 380 time: 0.0547705 Nov 15 17:53:30.223862 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'port': {'device_id': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'admin_state_up': True, 'tenant_id': '230fd761d538456998d7b335d14192ff', 'security_groups': ['52caeb19-493c-4fbf-a742-97c911021216']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:30.274735 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be4e5c1-9a22-4b99-83f3-2d4ea0a12c1a req-1eac44f8-fabb-4227-8389-cccb8570ed14 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:30.276958 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0be4e5c1-9a22-4b99-83f3-2d4ea0a12c1a req-1eac44f8-fabb-4227-8389-cccb8570ed14 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0508428 Nov 15 17:53:30.331740 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0be4e5c1-9a22-4b99-83f3-2d4ea0a12c1a req-8a94ceeb-f86d-4b6e-926f-c8a2651b7fdc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429716 Nov 15 17:53:30.337311 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Made reservation on behalf of 230fd761d538456998d7b335d14192ff for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:53:30.341413 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.471476 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Allocated IP 172.20.0.3 (e40bb745-7523-4329-91e3-c55442c5a8fa/ceb6358c-736e-42b9-8a34-e129c4912f6f/bbb87da9-bfbe-470d-bf32-ec2b93afbbb3) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:30.611301 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.645665 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.692637 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Network e40bb745-7523-4329-91e3-c55442c5a8fa is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:30.697825 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:30.702298 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:30.706152 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event updated for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:30.755443 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:30.756090 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.773450 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f6510792-fd46-41fb-92a7-bd4f17b57f28 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5540276 Nov 15 17:53:30.785335 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8519e30-c58e-48aa-957a-4bea99da0b50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.916191 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-3fa34f01-fb87-408d-8941-686571b28d75 None None] Provisioning complete for port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:30.916556 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3fa34f01-fb87-408d-8941-686571b28d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:30.952730 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-3fa34f01-fb87-408d-8941-686571b28d75 None None] Port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:53:31.313696 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53572a5c-26de-49fc-aac5-bb95f93cdbc3 req-7083e427-6012-4cb9-92b7-390096db5d4d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:31.315163 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-53572a5c-26de-49fc-aac5-bb95f93cdbc3 req-7083e427-6012-4cb9-92b7-390096db5d4d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 931 time: 0.0563757 Nov 15 17:53:31.367505 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-53572a5c-26de-49fc-aac5-bb95f93cdbc3 req-14c8d622-4da6-4a64-af0c-d687dd43cb1d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427356 Nov 15 17:53:31.458655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2adc2f0f-116c-4def-a57d-590258b6fde2 req-ab6e7461-73a7-4010-9afc-8b5175bcdc47 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:31.460190 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2adc2f0f-116c-4def-a57d-590258b6fde2 req-ab6e7461-73a7-4010-9afc-8b5175bcdc47 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0508344 Nov 15 17:53:31.511246 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2adc2f0f-116c-4def-a57d-590258b6fde2 req-11cba3d8-c53f-40db-a5a5-61de765a44cc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431304 Nov 15 17:53:32.506002 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa46c2b-3cb5-4bc6-b004-c54d7444afc1 req-27c49acd-da51-4f37-a1de-6d57bd43d037 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:32.507493 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3fa46c2b-3cb5-4bc6-b004-c54d7444afc1 req-27c49acd-da51-4f37-a1de-6d57bd43d037 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 931 time: 0.0577226 Nov 15 17:53:32.559359 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3fa46c2b-3cb5-4bc6-b004-c54d7444afc1 req-ef4738df-e137-4562-9af7-153686a39b77 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457389 Nov 15 17:53:32.636930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebcaaac-07a2-419e-a58a-771b17931ff4 req-1060b9cc-d9cd-4fde-9038-5f12db02cc78 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:32.639163 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aebcaaac-07a2-419e-a58a-771b17931ff4 req-1060b9cc-d9cd-4fde-9038-5f12db02cc78 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0565557 Nov 15 17:53:32.684294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Request body: {'port': {'device_id': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:32.691995 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-aebcaaac-07a2-419e-a58a-771b17931ff4 req-8d4121dd-dc20-457e-bcc4-41ae1b88cb24 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469277 Nov 15 17:53:32.740574 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.008949 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:33.016634 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.029091 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Transition to ACTIVE for port object bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:53:33.035105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.087457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Pushing event updated for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:33.094572 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-307c3046-1487-4302-845f-e75d9d68453e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.156622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Attempting to bind port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:53:33.157092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Attempting to bind port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:53:33.157518 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Attempting to bind port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:33.161894 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 on network e40bb745-7523-4329-91e3-c55442c5a8fa not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:53:33.162212 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Attempting to bind port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 on network e40bb745-7523-4329-91e3-c55442c5a8fa {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:33.169145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 53, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:53:33.169481 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Checking segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:53:33.169871 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Bound using segment: {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:53:33.170432 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Bound port: bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '65df5835-7d4f-417d-9f6f-35166467b466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 409, 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:53:33.170789 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.236758 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:53:33.239941 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:53:33.246181 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.278126 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.278953 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:33.280369 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] 10.222.0.48 "PUT /v2.0/ports/bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 HTTP/1.1" status: 200 len: 1093 time: 0.6528049 Nov 15 17:53:33.280841 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:33.283052 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59f21449-0ccd-409f-80e8-9e7815e4a56a" -d '{"events": [{"name": "network-changed", "server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:33.310384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8062151-5dbb-4a9d-b5b6-f717896231b7 service neutron] Pushing event updated for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:33.399609 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0916726-75f1-4714-938e-21cb7fc2dbb4 x-openstack-request-id: req-b0916726-75f1-4714-938e-21cb7fc2dbb4 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:33.399917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:33.400169 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b0916726-75f1-4714-938e-21cb7fc2dbb4 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:33.400574 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'status': 'completed', 'code': 200} Nov 15 17:53:33.676479 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d9d0d88-628a-4e14-b19b-433bb76cce0f req-94536ba5-dae8-4cce-9dbf-0b61b7e8cb27 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.678085 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5d9d0d88-628a-4e14-b19b-433bb76cce0f req-94536ba5-dae8-4cce-9dbf-0b61b7e8cb27 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0508001 Nov 15 17:53:33.695537 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-7ea147f1-30f6-452a-8276-2d16bcb02c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.697110 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-7ea147f1-30f6-452a-8276-2d16bcb02c21 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 1096 time: 0.0447545 Nov 15 17:53:33.725753 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5d9d0d88-628a-4e14-b19b-433bb76cce0f req-4dd96784-ce61-467b-8230-d73329b1933e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414219 Nov 15 17:53:33.810458 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-1fabfc90-61e4-450a-9d30-5b80338e916c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.811869 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-1fabfc90-61e4-450a-9d30-5b80338e916c service neutron] 10.222.0.48 "GET /v2.0/networks?tenant_id=230fd761d538456998d7b335d14192ff&shared=False HTTP/1.1" status: 200 len: 912 time: 0.0993941 Nov 15 17:53:33.834963 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c468286-9cf2-4b5e-a4a0-0b0ba58d69c2 req-1adf5475-244c-49e7-a1de-fdf16638b3bb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.836487 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4c468286-9cf2-4b5e-a4a0-0b0ba58d69c2 req-1adf5475-244c-49e7-a1de-fdf16638b3bb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.0527697 Nov 15 17:53:33.888783 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4c468286-9cf2-4b5e-a4a0-0b0ba58d69c2 req-9e63e91f-6f13-4dec-9649-ed578940842d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=80e4d0ba-b6e2-415e-9ff2-8b59489ede80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458210 Nov 15 17:53:33.912827 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-df0c56a9-3e37-4f02-a572-f89fb4c2ba3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:33.914283 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-59f21449-0ccd-409f-80e8-9e7815e4a56a req-df0c56a9-3e37-4f02-a572-f89fb4c2ba3a service neutron] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0915232 Nov 15 17:53:34.003546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-5253c2f4-c0ec-4e26-b4f4-a6c280c1ceb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:34.005026 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-5253c2f4-c0ec-4e26-b4f4-a6c280c1ceb4 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 1096 time: 0.0512848 Nov 15 17:53:34.285755 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-8278b05a-337b-44ed-aad2-119ba566371d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 HTTP/1.1" status: 200 len: 217 time: 0.2679937 Nov 15 17:53:34.312165 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-37212c8b-9dcc-405e-9cdc-fbf34ef15117 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:34.313529 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-37212c8b-9dcc-405e-9cdc-fbf34ef15117 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 946 time: 0.3237693 Nov 15 17:53:34.377966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-85b1f350-186a-4aef-8995-25daf879db7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:34.379388 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-85b1f350-186a-4aef-8995-25daf879db7f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.0841315 Nov 15 17:53:34.451152 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-852dd017-35b3-47af-a52d-b9dc280db24d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:34.452629 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-852dd017-35b3-47af-a52d-b9dc280db24d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0562310 Nov 15 17:53:34.459065 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Deleting port db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:53:34.459397 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.469367 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.606372 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] For port db874a84-aa99-4b23-9465-3c565bb54cf2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=db874a84-aa99-4b23-9465-3c565bb54cf2,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:34.606734 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.616059 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-34b61228-f166-4092-9739-eefc11102ca8 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1537600 Nov 15 17:53:34.825671 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ebe6b1ae-78c2-415b-8732-2a9a68465042 req-82e10de2-3526-4136-a05b-de0db7adee11 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1756604 Nov 15 17:53:34.844926 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f6b361-1031-42b2-aba7-0f5a81c099dc req-218a77d4-041c-4b80-9db5-896e7a3e1d34 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:34.846781 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-66f6b361-1031-42b2-aba7-0f5a81c099dc req-218a77d4-041c-4b80-9db5-896e7a3e1d34 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0499642 Nov 15 17:53:34.848925 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.849294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.849589 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Floating IP bc4db52c-d6d8-49df-9712-b317100d67f3 disassociated. External IP: 172.27.0.110, port: db874a84-aa99-4b23-9465-3c565bb54cf2. Nov 15 17:53:34.849970 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Calling delete_port for db874a84-aa99-4b23-9465-3c565bb54cf2 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:53:34.895771 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-66f6b361-1031-42b2-aba7-0f5a81c099dc req-48ea3b26-6638-4fff-910c-4fc4036f44f0 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419414 Nov 15 17:53:34.974546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:34.991217 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-834087c2-2895-4ef7-82af-0503e9a90200 req-455e6325-4b13-4ee4-a424-4625be95dbe4 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0256760 Nov 15 17:53:35.005156 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'Port': ['ID=db874a84-aa99-4b23-9465-3c565bb54cf2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:35.126430 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:53:35.234066 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:53:35.245176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:53:35.255904 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:35.256473 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:35.275438 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] No DVR routers for this DVR port db874a84-aa99-4b23-9465-3c565bb54cf2 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:53:35.278082 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:35.281771 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-62639bfc-87ef-4d92-a0c0-1b8f8e63cfec req-bb0d79d9-6aca-477a-ac8a-beb615edfdec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "DELETE /v2.0/ports/db874a84-aa99-4b23-9465-3c565bb54cf2 HTTP/1.1" status: 204 len: 173 time: 0.9520850 Nov 15 17:53:35.361827 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:35.402022 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-deleted', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:35.404701 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96bdaffe-6c87-4881-9091-4af63ae60619" -d '{"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-deleted", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:35.446627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0dd901e0-7af9-4d2a-875a-231d2bb39b68 x-openstack-request-id: req-0dd901e0-7af9-4d2a-875a-231d2bb39b68 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:35.447063 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5eadb4e7-a4ba-49a6-911b-5cd95450f64d", "name": "network-vif-deleted", "tag": "db874a84-aa99-4b23-9465-3c565bb54cf2", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:35.447322 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-0dd901e0-7af9-4d2a-875a-231d2bb39b68 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:35.447754 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5eadb4e7-a4ba-49a6-911b-5cd95450f64d', 'name': 'network-vif-deleted', 'tag': 'db874a84-aa99-4b23-9465-3c565bb54cf2', 'status': 'completed', 'code': 200} Nov 15 17:53:35.575195 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:35.578591 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:35.601398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:53:35.610008 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:35.610591 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:35.714557 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:35.915731 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:35.945789 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da3d723d-aa59-4ea8-b8a5-4a647b9c6767 None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:53:36.014120 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16630ddf-78cb-4c70-98b5-e33af4bc514e req-d6037fa4-cb0c-447e-84c5-7032e7546304 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:36.015628 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-16630ddf-78cb-4c70-98b5-e33af4bc514e req-d6037fa4-cb0c-447e-84c5-7032e7546304 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0535364 Nov 15 17:53:36.072430 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-16630ddf-78cb-4c70-98b5-e33af4bc514e req-80b5ddcf-3c1f-4b6b-a8d3-2327388a8273 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483720 Nov 15 17:53:36.114856 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-90d5baff-e56f-44cd-b366-28eb39b4a2a8 req-a536162b-52ce-405d-be9a-7270a1e2a3e6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0274117 Nov 15 17:53:36.176483 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72169ee6-4a69-4ef5-b6f8-ce8b8865dbfb None None] New status for floating IP bc4db52c-d6d8-49df-9712-b317100d67f3: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:53:36.667827 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:37.193482 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e266b8-75a1-4813-a12d-3c0efad071aa req-2ce8f23a-af9b-421e-95f6-ad51f4427a7f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:37.194942 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-12e266b8-75a1-4813-a12d-3c0efad071aa req-2ce8f23a-af9b-421e-95f6-ad51f4427a7f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0485835 Nov 15 17:53:37.224497 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-edd9c1fa-a28e-40dc-90aa-6f25388526b7 req-dbdce453-d269-4e2b-94fc-b899e8595eeb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0286524 Nov 15 17:53:37.261746 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-12e266b8-75a1-4813-a12d-3c0efad071aa req-db1868ed-2409-4995-9d90-435f4dfebc2e tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578065 Nov 15 17:53:38.348022 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-df34313a-743b-46d5-b9da-8e4bdba1ba4d req-486c5f8f-dc31-4a4b-a3f1-1f17b2e24aa0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=5eadb4e7-a4ba-49a6-911b-5cd95450f64d HTTP/1.1" status: 200 len: 210 time: 0.0347984 Nov 15 17:53:38.398876 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e980503c-26cc-485f-a9b5-351dd92c37f1 req-3a86f001-7015-47c9-a438-d9862b84c7ab tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:38.400373 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e980503c-26cc-485f-a9b5-351dd92c37f1 req-3a86f001-7015-47c9-a438-d9862b84c7ab tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0547745 Nov 15 17:53:38.448083 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e980503c-26cc-485f-a9b5-351dd92c37f1 req-0120b74f-bf07-48ff-8531-8f0a3d45b3f0 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414691 Nov 15 17:53:39.451524 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59678) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:39.506631 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.552390 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.596900 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f41301-d6c4-47fd-b309-b53260aff5b8 req-faceb9a2-a987-436a-bf15-b9e162812e37 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:39.598361 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-40f41301-d6c4-47fd-b309-b53260aff5b8 req-faceb9a2-a987-436a-bf15-b9e162812e37 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 943 time: 0.0815887 Nov 15 17:53:39.626366 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.628919 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.630018 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "DELETE /v2.0/security-groups/80e4d0ba-b6e2-415e-9ff2-8b59489ede80 HTTP/1.1" status: 204 len: 168 time: 0.1774478 Nov 15 17:53:39.632927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59682) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:39.646746 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.api.v2.resource [None req-6221cc76-ba11-4b03-87a4-496275643638 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] show failed (client error): The resource could not be found. Nov 15 17:53:39.650573 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-6221cc76-ba11-4b03-87a4-496275643638 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups/80e4d0ba-b6e2-415e-9ff2-8b59489ede80 HTTP/1.1" status: 404 len: 347 time: 0.0164962 Nov 15 17:53:39.651184 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59684) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:39.651928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02cbfb47-f062-46b7-8e57-bf1152ff3329 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=80e4d0ba-b6e2-415e-9ff2-8b59489ede80,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:39.695210 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-40f41301-d6c4-47fd-b309-b53260aff5b8 req-942a5406-f33b-4441-9929-0ed59d864351 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0908289 Nov 15 17:53:39.786821 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Deleting port 72c30e68-37dc-49d9-b09b-ca6116af869b {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:53:39.787159 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.873739 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:53:39.877779 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:53:39.878022 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.878353 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:39.891792 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Calling delete_port for 72c30e68-37dc-49d9-b09b-ca6116af869b owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:53:39.904547 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: db874a84-aa99-4b23-9465-3c565bb54cf2 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:53:39.905083 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device db874a84-aa99-4b23-9465-3c565bb54cf2 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:53:39.992304 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:40.003961 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'port_id': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'mac_address': 'fa:16:3e:60:1c:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 409, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:53:40.041430 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.042049 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.050599 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:53:40.056043 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:40.067729 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'Port': ['ID=72c30e68-37dc-49d9-b09b-ca6116af869b,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:40.076259 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:40.081166 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.129908 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:40.131814 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.134470 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.135721 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-03b317a8-c11d-4108-bcfe-d2179ffbbf84 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "DELETE /v2.0/floatingips/bc4db52c-d6d8-49df-9712-b317100d67f3 HTTP/1.1" status: 204 len: 168 time: 0.4815457 Nov 15 17:53:40.334205 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:53:40.451812 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59694) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:40.456765 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1782437082', 'description': 'tempest-description--2072396789'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:40.480721 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.545331 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.552343 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.584600 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.585803 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1329379 Nov 15 17:53:40.588932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59696) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:40.593761 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group_rule': {'security_group_id': 'd4010d4b-711f-4151-a3f1-d93907a44e0a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:40.593945 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c85f1a6-9b58-45f0-80e2-6afade2cd6d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d4010d4b-711f-4151-a3f1-d93907a44e0a,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:40.623182 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.677099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.681997 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.700483 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1b03420-7b86-4c1f-82ea-aeb67bb7289a,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:40.709755 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.710900 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1208255 Nov 15 17:53:40.712308 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.712646 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.712967 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.713289 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.713612 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.713887 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59698) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:40.713993 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.714247 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.714546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.714859 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.715170 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.715482 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.717122 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f54a7c63-ff5f-4018-a3f1-6ee7540ebab6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:40.721376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'security_group_rule': {'security_group_id': 'd4010d4b-711f-4151-a3f1-d93907a44e0a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:40.751243 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.829664 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.837826 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4c449e-74ac-4de1-a00d-7240885af883 req-960b017c-62ba-4dd3-9028-0d381044ac35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:40.839267 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5d4c449e-74ac-4de1-a00d-7240885af883 req-960b017c-62ba-4dd3-9028-0d381044ac35 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 944 time: 0.0751746 Nov 15 17:53:40.840354 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.872129 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1843c9e-56b0-418f-a2cb-295b79bde412,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:40.885351 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:40.886517 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-66515f2c-a2cd-46df-8e2e-f2d06e06f968 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1715512 Nov 15 17:53:40.890056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 59702) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:40.895009 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:40.911299 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5d4c449e-74ac-4de1-a00d-7240885af883 req-35100836-eea5-4958-97f2-73c55e558f57 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0636196 Nov 15 17:53:40.920185 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.023528 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.124954 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Allocated IP 172.27.0.124 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/862f48bf-1dfa-4007-8c43-caa7631ca8bc) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:41.228620 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.263865 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.304471 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:41.307263 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:41.309888 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:41.334544 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=862f48bf-1dfa-4007-8c43-caa7631ca8bc,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:41.437834 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.479385 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.626112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.633086 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.693168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=862f48bf-1dfa-4007-8c43-caa7631ca8bc,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:41.707934 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.724526 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:41.725775 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-fa0fa891-22f6-4f6e-b5dd-ec902a678a37 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8345752 Nov 15 17:53:41.888806 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:53:41.929821 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-87610db6-41ff-4aea-85f3-202a5c733f91 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1782437082&fields=id&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 267 time: 0.0437016 Nov 15 17:53:41.945247 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:53:41.949398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:41.949911 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:42.027252 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:42.054080 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:42.056433 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f6b1c74-04a0-49fb-80af-68ca24bad30c" -d '{"events": [{"server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "name": "network-vif-plugged", "status": "completed", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:42.071370 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:42.077007 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:42.257357 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:42.265063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.265420 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.265757 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.266079 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.266396 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.266715 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.267043 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.267343 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.267659 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.268005 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.268314 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.268619 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:53:42.284720 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e462e7-a97b-4338-8044-6290affc9be0 req-cf1eaf6c-4fcf-40fe-afdd-40f75f197072 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:42.286187 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-03e462e7-a97b-4338-8044-6290affc9be0 req-cf1eaf6c-4fcf-40fe-afdd-40f75f197072 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0741444 Nov 15 17:53:42.308443 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-f68c4337-c01f-4f29-b564-b82d031e4c0e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:42.309794 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-f68c4337-c01f-4f29-b564-b82d031e4c0e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 817 time: 0.3723514 Nov 15 17:53:42.331066 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c48af7a1-ffd8-4ba8-b666-0583db275094 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/quotas/8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 375 time: 0.0151477 Nov 15 17:53:42.377638 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-03e462e7-a97b-4338-8044-6290affc9be0 req-899e30b9-3aa9-4d4a-8da3-60e3e4ccba9d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842931 Nov 15 17:53:42.401094 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-7de355d0-d105-40a2-88bd-249e05aac5ec tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0645676 Nov 15 17:53:42.423313 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d0bfd1d-4a37-4403-8431-1fde2a5012df x-openstack-request-id: req-9d0bfd1d-4a37-4403-8431-1fde2a5012df {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:42.423594 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "name": "network-vif-plugged", "status": "completed", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:42.423889 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9d0bfd1d-4a37-4403-8431-1fde2a5012df {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:42.424281 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'code': 200} Nov 15 17:53:42.557565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-b1ee6582-6833-4241-a3a6-7443e9886b10 service neutron] 10.222.0.31 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1441381 Nov 15 17:53:42.621657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e5b26c-7cba-4d40-8979-5b2a2c5935e9 req-08c4ff0d-fd3d-41e9-b72a-21ef250912a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:42.624339 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-18e5b26c-7cba-4d40-8979-5b2a2c5935e9 req-08c4ff0d-fd3d-41e9-b72a-21ef250912a3 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 1098 time: 0.0509176 Nov 15 17:53:42.668276 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-5666fdb3-0a9b-484f-a1ce-30ffd7446b3d service neutron] 10.222.0.31 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1042686 Nov 15 17:53:42.689709 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-18e5b26c-7cba-4d40-8979-5b2a2c5935e9 req-14b2c2ce-3c83-4830-8c6f-4bd3eaf6dd6d service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474181 Nov 15 17:53:42.825258 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-65bcd1aa-b58f-4577-9732-c1c43176dae2 req-d93641bf-476f-40a5-b14c-55550c447cb0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 210 time: 0.0261471 Nov 15 17:53:43.497548 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3913381d-431d-465e-98f3-b92f3909c930 req-b7c2737e-8048-4b7c-a0e2-c642eeec344d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:43.499176 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3913381d-431d-465e-98f3-b92f3909c930 req-b7c2737e-8048-4b7c-a0e2-c642eeec344d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0508623 Nov 15 17:53:43.547214 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3913381d-431d-465e-98f3-b92f3909c930 req-0dea3843-fa75-417e-b0ee-478b2165b268 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411708 Nov 15 17:53:43.861142 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-3ea275cb-2f44-4150-a9b6-4d22f69b5f9b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:43.862883 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-3ea275cb-2f44-4150-a9b6-4d22f69b5f9b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 817 time: 0.1053307 Nov 15 17:53:43.937273 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-428706b0-0929-45c4-a78f-68a342217c0a req-f5044bfb-424e-456a-8b23-b79aadb4c67e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 210 time: 0.0330572 Nov 15 17:53:43.954984 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-3c0199c1-83c3-4b93-98f5-2da838dc0583 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 380 time: 0.0661452 Nov 15 17:53:43.972118 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'port': {'device_id': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'admin_state_up': True, 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'security_groups': ['d4010d4b-711f-4151-a3f1-d93907a44e0a']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:43.987659 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d25b13c-1e3f-4194-98fb-de6f633599c1 req-54ff3fcc-67f2-4db4-be87-72c9323575aa tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:43.989794 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4d25b13c-1e3f-4194-98fb-de6f633599c1 req-54ff3fcc-67f2-4db4-be87-72c9323575aa tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0563025 Nov 15 17:53:44.041550 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4d25b13c-1e3f-4194-98fb-de6f633599c1 req-f6ae7f3f-a00b-4d73-b3ba-47a4d66da399 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440335 Nov 15 17:53:44.085185 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Made reservation on behalf of 8d7c8a074d704613bf45e1c8d95834e9 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:53:44.089089 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.217598 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Allocated IP 172.20.0.7 (927b3da0-f3f2-41e8-b00d-4ab5e71093d8/82578c0d-639e-4df9-bec7-8ae336a8ba92/c13f1e6c-0ca0-42d7-9725-f91a42d82e8c) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:44.350978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.390129 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.431161 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:44.434305 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:44.438254 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:44.461234 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:44.489172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:44.489778 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.507054 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-c342dc78-757b-48ec-b507-33f270e18dda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5393207 Nov 15 17:53:44.522845 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Request body: {'port': {'device_id': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:44.581024 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.646575 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-9ad84894-f103-4648-8d8d-84ad9aa64071 None None] Provisioning complete for port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:44.647165 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9ad84894-f103-4648-8d8d-84ad9aa64071 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.668837 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da0d6e0-868d-4a45-a836-8e7b2d94f4e3 req-15be7e43-9203-4b58-9426-3b9f1f4a64a4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:44.676195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6da0d6e0-868d-4a45-a836-8e7b2d94f4e3 req-15be7e43-9203-4b58-9426-3b9f1f4a64a4 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0595424 Nov 15 17:53:44.682568 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-9ad84894-f103-4648-8d8d-84ad9aa64071 None None] Port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:53:44.719367 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6da0d6e0-868d-4a45-a836-8e7b2d94f4e3 req-8bab4040-8b0a-44c6-8a1e-418f34fc9a5d tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423100 Nov 15 17:53:44.832739 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9d51ed-6262-48c4-af0b-ce53a127899c req-df380656-27a4-4cdf-b675-ad1e32b08983 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:44.834218 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ed9d51ed-6262-48c4-af0b-ce53a127899c req-df380656-27a4-4cdf-b675-ad1e32b08983 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0519547 Nov 15 17:53:44.843037 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:44.843388 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59768) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:44.847925 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Request body: {'floatingip': {'port_id': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:44.848072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.860054 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Transition to ACTIVE for port object c13f1e6c-0ca0-42d7-9725-f91a42d82e8c will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:53:44.864901 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.887922 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:44.934396 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:44.992653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Attempting to bind port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:53:44.993075 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Attempting to bind port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:53:44.993472 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Attempting to bind port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:44.998715 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:53:44.998715 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Attempting to bind port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c on network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:45.003947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 53, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:53:45.004420 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Checking segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:53:45.004876 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Bound using segment: {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:53:45.005868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Bound port: c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '27f12457-b2da-466e-9e22-d4c08a5b79c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 447, 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:53:45.005868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.080648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:53:45.085460 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:53:45.093977 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.127755 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.128375 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.129736 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] 10.222.0.48 "PUT /v2.0/ports/c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 1093 time: 0.6112401 Nov 15 17:53:45.130325 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:45.132401 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8aa48d3-cdab-4d23-8780-4bca7299394b" -d '{"events": [{"name": "network-changed", "server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:45.155387 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd6f70d-f5a0-4ddb-a12d-030efc06d6ad service neutron] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:45.186329 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9428ce17-87a4-41bb-af6c-415900200708 req-4567442c-ffec-4c49-ae2e-4773573df8f7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.187898 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9428ce17-87a4-41bb-af6c-415900200708 req-4567442c-ffec-4c49-ae2e-4773573df8f7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.1417260 Nov 15 17:53:45.225237 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-b17a923e-e1c5-4898-8a4b-23862bf6016f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.226821 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-b17a923e-e1c5-4898-8a4b-23862bf6016f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1096 time: 0.0509157 Nov 15 17:53:45.257631 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96afa031-849a-412c-bbcc-0f371536916c req-0ca99e31-7695-4617-9e1e-c28546d12bec tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.259481 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-96afa031-849a-412c-bbcc-0f371536916c req-0ca99e31-7695-4617-9e1e-c28546d12bec tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.1393552 Nov 15 17:53:45.280171 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-39365cdd-e26e-453b-b418-c7ab8d27d832 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 217 time: 0.0437236 Nov 15 17:53:45.339557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-1c727b5d-6feb-4d41-b6ee-57629ad24bea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.341083 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-1c727b5d-6feb-4d41-b6ee-57629ad24bea service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0527570 Nov 15 17:53:45.381563 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9428ce17-87a4-41bb-af6c-415900200708 req-3b670009-6422-490b-a5bc-1d6ca19633d6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1613600 Nov 15 17:53:45.400284 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bed68035-35cd-4e86-bed6-4d99b89dbe1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.401771 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-bed68035-35cd-4e86-bed6-4d99b89dbe1b service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447767 Nov 15 17:53:45.405163 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-96afa031-849a-412c-bbcc-0f371536916c req-7e254509-7af6-40e6-929e-1df35278e5ae tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836544 Nov 15 17:53:45.466206 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69cc4224-4571-40b1-ba06-f4a0a70cecc7 x-openstack-request-id: req-69cc4224-4571-40b1-ba06-f4a0a70cecc7 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:45.466717 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:45.466951 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-69cc4224-4571-40b1-ba06-f4a0a70cecc7 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:45.467427 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'status': 'completed', 'code': 200} Nov 15 17:53:45.510174 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.514869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.516882 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-66189033-763b-44c0-8061-6346f4fd5124 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1036425 Nov 15 17:53:45.617205 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-1b01454a-8f21-4d48-97d1-20b15c68b2e7 req-40f4203d-cc16-42a9-8836-28918b692f32 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878124 Nov 15 17:53:45.620239 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Floating IP c82bba7b-808d-4bc0-9106-e5e7828ce50d associated. External IP: 172.27.0.11, port: bbb87da9-bfbe-470d-bf32-ec2b93afbbb3. Nov 15 17:53:45.717774 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-0e68d215-c6d0-48df-b6fc-f8c68e9bf3ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:45.719625 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-0e68d215-c6d0-48df-b6fc-f8c68e9bf3ba service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1096 time: 0.0420697 Nov 15 17:53:45.844924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:53:45.963531 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:53:45.968321 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:45.974958 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:53:45.986324 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:45.987279 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:45.999525 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-539fcdd6-e490-4d2d-b674-a519a6faadc6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "PUT /v2.0/floatingips/c82bba7b-808d-4bc0-9106-e5e7828ce50d HTTP/1.1" status: 200 len: 990 time: 1.1549726 Nov 15 17:53:46.000284 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:46.002674 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f568fe19-6588-4feb-aa37-ee10849a6a32" -d '{"events": [{"name": "network-changed", "server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:46.103832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-a62d239d-c056-4cd5-8403-4c4ffdbb88b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.105321 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-a62d239d-c056-4cd5-8403-4c4ffdbb88b6 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.3770137 Nov 15 17:53:46.116300 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:46.130727 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92ec622-2319-498e-930f-b3eee972b69f req-881c0b49-9dda-45d4-8eba-5fbc09ae6c6a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.132259 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d92ec622-2319-498e-930f-b3eee972b69f req-881c0b49-9dda-45d4-8eba-5fbc09ae6c6a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0671327 Nov 15 17:53:46.133242 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e0ecb88-8e33-4859-bb5e-fb77d51431b4 x-openstack-request-id: req-7e0ecb88-8e33-4859-bb5e-fb77d51431b4 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:46.133532 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:46.133786 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-7e0ecb88-8e33-4859-bb5e-fb77d51431b4 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:46.134182 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'status': 'completed', 'code': 200} Nov 15 17:53:46.176637 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-6a781288-5543-4075-9f91-d10e9f2a0211 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 217 time: 0.0586791 Nov 15 17:53:46.303751 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-3ac050f6-a00c-4546-9506-485039769983 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.309449 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-3ac050f6-a00c-4546-9506-485039769983 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.1013258 Nov 15 17:53:46.312849 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-50305a60-79a8-4602-a548-a0dd835c0417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.314260 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-50305a60-79a8-4602-a548-a0dd835c0417 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=230fd761d538456998d7b335d14192ff&device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 1098 time: 0.1356313 Nov 15 17:53:46.354116 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'c82bba7b-808d-4bc0-9106-e5e7828ce50d', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.11', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:60:1c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:27Z', 'updated_at': '2021-11-15T17:53:45Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:46.380542 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:53:46.390458 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:46.391084 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:46.441077 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Deleting port 0e55f4c6-59af-4793-bbaa-734697e79a75 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:53:46.441414 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:46.509819 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-f3a2bf2e-461f-48ab-82c7-85e76821f840 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.511323 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-f3a2bf2e-461f-48ab-82c7-85e76821f840 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1952651 Nov 15 17:53:46.517291 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:46.543180 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-298479c8-7615-480f-bd63-e728b8628fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.545003 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-298479c8-7615-480f-bd63-e728b8628fbe service neutron] 10.222.0.48 "GET /v2.0/networks?id=e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 200 len: 912 time: 0.2199392 Nov 15 17:53:46.559299 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46301e9b-d554-4e43-abaf-3459a9d17771 req-127344c5-ebbf-4913-b2dc-d945ad8d18d8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.560923 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-46301e9b-d554-4e43-abaf-3459a9d17771 req-127344c5-ebbf-4913-b2dc-d945ad8d18d8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0836344 Nov 15 17:53:46.573753 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317bf680-dbaa-46e7-8a3f-fe16b4d9dba2 req-775c4a67-8af1-4c0f-88fd-17478f02aff4 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.575335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-317bf680-dbaa-46e7-8a3f-fe16b4d9dba2 req-775c4a67-8af1-4c0f-88fd-17478f02aff4 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=fe6d2dcc-03db-48d0-a8cb-38ec8be79da3 HTTP/1.1" status: 200 len: 945 time: 0.0704038 Nov 15 17:53:46.648226 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-46301e9b-d554-4e43-abaf-3459a9d17771 req-b9461c5b-e6d7-49eb-b886-d4a8d8e95bfb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715826 Nov 15 17:53:46.654221 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-317bf680-dbaa-46e7-8a3f-fe16b4d9dba2 req-32862211-655b-4847-961f-1d58873d0fa4 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717125 Nov 15 17:53:46.682857 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] For port 0e55f4c6-59af-4793-bbaa-734697e79a75, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=0e55f4c6-59af-4793-bbaa-734697e79a75,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:46.683228 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:46.709931 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-022b8931-5d5b-4dd0-a8a4-e5b82ec8977e service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 HTTP/1.1" status: 200 len: 998 time: 0.1503327 Nov 15 17:53:46.712040 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Calling delete_port for 0e55f4c6-59af-4793-bbaa-734697e79a75 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:53:46.760540 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-dc34d298-8c3d-40a7-9289-19a2eff97435 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2400978 Nov 15 17:53:46.771411 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'c82bba7b-808d-4bc0-9106-e5e7828ce50d', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.11', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:60:1c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:27Z', 'updated_at': '2021-11-15T17:53:45Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:46.797716 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb6b5845-5413-4481-89a5-08b183fcf352 None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': 'c82bba7b-808d-4bc0-9106-e5e7828ce50d', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'floating_ip_address': '172.27.0.11', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'port_id': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'mac_address': 'fa:16:3e:60:1c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:27Z', 'updated_at': '2021-11-15T17:53:45Z', 'revision_number': 1, 'project_id': '230fd761d538456998d7b335d14192ff', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:53:46.855880 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-517b3878-0b91-4849-9a8f-d0c16cc016df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.857814 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-517b3878-0b91-4849-9a8f-d0c16cc016df service neutron] 10.222.0.48 "GET /v2.0/subnets?id=ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 200 len: 850 time: 0.1329381 Nov 15 17:53:46.963144 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a8aa48d3-cdab-4d23-8780-4bca7299394b req-4a094c20-ca84-4b69-bccb-0e03bf1f6649 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1634943 Nov 15 17:53:46.985613 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-687bb3eb-9130-40aa-8775-41fb35a83df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:46.987110 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-687bb3eb-9130-40aa-8775-41fb35a83df6 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=e40bb745-7523-4329-91e3-c55442c5a8fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1215615 Nov 15 17:53:47.000981 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d203ddcc-a2a5-4aad-9945-b39d1c779f9d None None] New status for floating IP c82bba7b-808d-4bc0-9106-e5e7828ce50d: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:53:47.054443 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:47.066337 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['0e55f4c6-59af-4793-bbaa-734697e79a75'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:53:47.091349 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Pushing event deleted for resources: {'Port': ['ID=0e55f4c6-59af-4793-bbaa-734697e79a75,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:47.162550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] No DVR routers for this DVR port 0e55f4c6-59af-4793-bbaa-734697e79a75 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:53:47.165577 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:47.169056 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d92ec622-2319-498e-930f-b3eee972b69f req-1700eb10-a555-47ca-9760-c04ed9038b8c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "DELETE /v2.0/ports/0e55f4c6-59af-4793-bbaa-734697e79a75 HTTP/1.1" status: 204 len: 173 time: 0.9993272 Nov 15 17:53:47.171639 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-6a6fa72f-2221-49d4-a2e3-59aef25bbb53 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1768966 Nov 15 17:53:47.287256 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f568fe19-6588-4feb-aa37-ee10849a6a32 req-711149c8-dbe8-41ba-b1c7-adca2dd3a294 service neutron] 10.222.0.48 "GET /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023088 Nov 15 17:53:47.468500 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'name': 'network-vif-deleted', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:47.470957 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2757739e-f881-42dd-a6bc-00dbcdc18a2b" -d '{"events": [{"server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "name": "network-vif-deleted", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:47.510721 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97d3f44f-5295-415e-bd77-1599f0fc0d52 x-openstack-request-id: req-97d3f44f-5295-415e-bd77-1599f0fc0d52 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:47.511037 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe6d2dcc-03db-48d0-a8cb-38ec8be79da3", "name": "network-vif-deleted", "tag": "0e55f4c6-59af-4793-bbaa-734697e79a75", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:47.511283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-97d3f44f-5295-415e-bd77-1599f0fc0d52 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:47.511713 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe6d2dcc-03db-48d0-a8cb-38ec8be79da3', 'name': 'network-vif-deleted', 'tag': '0e55f4c6-59af-4793-bbaa-734697e79a75', 'status': 'completed', 'code': 200} Nov 15 17:53:47.785848 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36367f99-17d6-4d6a-a13c-fc7df6d1fea4 req-3e32f20e-e9bd-4a7c-b436-62ac783e6d75 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:47.787505 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-36367f99-17d6-4d6a-a13c-fc7df6d1fea4 req-3e32f20e-e9bd-4a7c-b436-62ac783e6d75 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0510771 Nov 15 17:53:47.839478 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-36367f99-17d6-4d6a-a13c-fc7df6d1fea4 req-f1c25051-07c0-4da1-9f7e-046cf302e098 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458109 Nov 15 17:53:47.927644 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:53:48.029194 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:48.043288 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:53:48.085157 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:48.098665 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:48.118629 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:48.125570 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:48.192400 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:48.979109 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfea963-771d-40e6-92ef-12b2d8098f30 req-809550a1-4a8e-4149-9c03-7bbeb7acedcb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:48.980611 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ecfea963-771d-40e6-92ef-12b2d8098f30 req-809550a1-4a8e-4149-9c03-7bbeb7acedcb tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0567913 Nov 15 17:53:49.031083 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ecfea963-771d-40e6-92ef-12b2d8098f30 req-dbacbe3d-d6ac-486f-a7e9-fc543a6fdcae tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438440 Nov 15 17:53:50.165407 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aee026e-cd08-4a9e-b5c8-b4df09987ae2 req-4606b06f-5ba8-458e-9f87-ad2eb8c64721 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:50.166861 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7aee026e-cd08-4a9e-b5c8-b4df09987ae2 req-4606b06f-5ba8-458e-9f87-ad2eb8c64721 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0553908 Nov 15 17:53:50.215981 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7aee026e-cd08-4a9e-b5c8-b4df09987ae2 req-03d7f7bd-7677-4fbd-856f-951b02f8a00a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403726 Nov 15 17:53:51.083917 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:53:51.354347 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7ccfd2-a329-489b-a3df-6b50633816fe req-3fcac9bd-92aa-43d6-9102-b67ea659d277 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:51.355823 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6e7ccfd2-a329-489b-a3df-6b50633816fe req-3fcac9bd-92aa-43d6-9102-b67ea659d277 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0524676 Nov 15 17:53:51.404686 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6e7ccfd2-a329-489b-a3df-6b50633816fe req-c92f7afe-c5d7-43db-8414-1a56d84d2710 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425560 Nov 15 17:53:52.342619 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:52.533220 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0528ac-e0c5-4f31-8c09-591f3a940671 req-aa8b4008-323e-42c2-a6a9-2d1067bae0f1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:52.534698 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1f0528ac-e0c5-4f31-8c09-591f3a940671 req-aa8b4008-323e-42c2-a6a9-2d1067bae0f1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0525882 Nov 15 17:53:52.585941 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1f0528ac-e0c5-4f31-8c09-591f3a940671 req-8d4f793d-f9a1-41aa-bb4d-9d60d1a084fe tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450354 Nov 15 17:53:53.429642 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:53:53.490904 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:53:53.495272 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:53:53.495663 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:53.570161 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:53.594974 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:53.597202 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2194143-8fd8-4399-a3c3-17b37ff8a15f" -d '{"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:53.609471 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:53:53.614571 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:53.615332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e55f4c6-59af-4793-bbaa-734697e79a75 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:53:53.650689 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 0e55f4c6-59af-4793-bbaa-734697e79a75 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:53:53.651030 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 0e55f4c6-59af-4793-bbaa-734697e79a75 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:53:53.681029 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:53.700204 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df88b47e-25c2-4cfc-993b-8d0da73eb1d4 x-openstack-request-id: req-df88b47e-25c2-4cfc-993b-8d0da73eb1d4 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:53.700517 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:53.700811 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-df88b47e-25c2-4cfc-993b-8d0da73eb1d4 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:53.701192 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'code': 200} Nov 15 17:53:53.792002 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c5806c-cb3a-4d59-91a1-4b3bdb14df38 req-f139c788-957a-491c-ae3f-d65e78dd6ed9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:53.793473 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c8c5806c-cb3a-4d59-91a1-4b3bdb14df38 req-f139c788-957a-491c-ae3f-d65e78dd6ed9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0509260 Nov 15 17:53:53.844590 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c8c5806c-cb3a-4d59-91a1-4b3bdb14df38 req-ee48f459-8fa9-4652-9cac-19565ac39958 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451167 Nov 15 17:53:54.983312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966d9926-1ffc-4751-8d72-5856842c3152 req-82a1ab79-0fcd-4987-af14-70837802f56c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:54.984797 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-966d9926-1ffc-4751-8d72-5856842c3152 req-82a1ab79-0fcd-4987-af14-70837802f56c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0528002 Nov 15 17:53:55.035152 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-966d9926-1ffc-4751-8d72-5856842c3152 req-df7c4ff8-5baf-4dbf-be11-fcd2e25dba3b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435650 Nov 15 17:53:55.428668 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-624a1168-9ed7-4c66-9f96-7596987e8282 req-1ddd593d-2509-4862-b28c-210228c09e29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:55.430175 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-624a1168-9ed7-4c66-9f96-7596987e8282 req-1ddd593d-2509-4862-b28c-210228c09e29 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1098 time: 0.0495734 Nov 15 17:53:55.481723 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-624a1168-9ed7-4c66-9f96-7596987e8282 req-f834b201-d083-4ff2-b050-674ebe55f2d2 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428677 Nov 15 17:53:55.669619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-2021f929-5811-4737-a665-6c2ff98ca179 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:55.671288 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-2021f929-5811-4737-a665-6c2ff98ca179 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 813 time: 0.1081173 Nov 15 17:53:55.686260 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-258a6000-6e79-4b08-9b64-fb22f261df2b tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/quotas/6cd9979609f846739626991354158923 HTTP/1.1" status: 200 len: 375 time: 0.0090537 Nov 15 17:53:55.716667 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-3ad5f4bf-68f9-4615-8c8c-7df9bbe63f38 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0251727 Nov 15 17:53:55.807888 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-7d140ff5-1e48-4edd-bf45-ee5bc03b6991 service neutron] 10.222.0.31 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841293 Nov 15 17:53:55.903430 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-b4b51b3f-9a9b-4793-b327-289e41479099 service neutron] 10.222.0.31 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860386 Nov 15 17:53:56.090130 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-21f43740-d979-4ad7-90bf-766266341e63 req-578500ac-72d2-4856-aa09-25b79d07d24e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 210 time: 0.0308425 Nov 15 17:53:56.167616 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18207894-edba-4e90-a6fe-0784e76ed436 req-fb4654aa-ddeb-4807-833c-eddee1ae944d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:56.169473 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18207894-edba-4e90-a6fe-0784e76ed436 req-fb4654aa-ddeb-4807-833c-eddee1ae944d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0561602 Nov 15 17:53:56.226881 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18207894-edba-4e90-a6fe-0784e76ed436 req-8c148331-15b7-4dea-8669-d154e241009c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501831 Nov 15 17:53:57.183950 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-a9a69e76-cecc-426c-8ad1-3788bdaceac0 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:57.186133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-a9a69e76-cecc-426c-8ad1-3788bdaceac0 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 813 time: 0.1131980 Nov 15 17:53:57.188099 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6c2c5034-6688-4ebe-b6c5-83b7efd6f566 req-fdeebe45-376b-472f-99ec-a3f228e9cda0 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 210 time: 0.0261121 Nov 15 17:53:57.204004 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Request body: {'port': {'device_id': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af', 'admin_state_up': True, 'tenant_id': '6cd9979609f846739626991354158923'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:57.317978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Made reservation on behalf of 6cd9979609f846739626991354158923 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:53:57.321757 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:57.352281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5d5564-ed94-4c95-8bb7-9cafe1326e0f req-3f95785e-b8c2-46cd-b46f-f20d5623d40a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:57.353783 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ca5d5564-ed94-4c95-8bb7-9cafe1326e0f req-3f95785e-b8c2-46cd-b46f-f20d5623d40a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0504653 Nov 15 17:53:57.405892 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ca5d5564-ed94-4c95-8bb7-9cafe1326e0f req-7c4d983f-d6b0-4e3e-b288-acd02cb73eb1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451849 Nov 15 17:53:57.453378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Allocated IP 172.20.0.3 (9f47de9d-364e-4427-8b37-d5720db906af/be29dea8-bad9-4c18-a288-475cbc179c1c/86113bff-095f-4781-bc90-bf1eb7991837) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:53:57.533658 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c925e0c-7e9c-45c3-9ad5-aed65f5c23d3 req-e58849fa-06c4-4e48-9845-d9b07a3387c9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:57.535138 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3c925e0c-7e9c-45c3-9ad5-aed65f5c23d3 req-e58849fa-06c4-4e48-9845-d9b07a3387c9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0558221 Nov 15 17:53:57.543743 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 59890) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:53:57.548779 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Request body: {'floatingip': {'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:57.588062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:57.608887 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:57.645757 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:57.691374 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Network 9f47de9d-364e-4427-8b37-d5720db906af is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:53:57.694718 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:53:57.699007 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:53:57.703180 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Pushing event updated for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:57.751436 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:57.752069 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:57.769820 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-17cd0f1c-d8fb-4d48-a17c-2ecf71b6aa2c tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5744574 Nov 15 17:53:57.785343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Request body: {'port': {'device_id': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:53:57.846814 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.113604 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 86113bff-095f-4781-bc90-bf1eb7991837 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:53:58.121514 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.133434 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Transition to ACTIVE for port object 86113bff-095f-4781-bc90-bf1eb7991837 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:53:58.137933 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.187094 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Pushing event updated for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:58.229095 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.234445 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.257979 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Attempting to bind port 86113bff-095f-4781-bc90-bf1eb7991837 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:53:58.258357 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Attempting to bind port 86113bff-095f-4781-bc90-bf1eb7991837 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:53:58.258632 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Attempting to bind port 86113bff-095f-4781-bc90-bf1eb7991837 on network 9f47de9d-364e-4427-8b37-d5720db906af {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:58.263298 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Port 86113bff-095f-4781-bc90-bf1eb7991837 on network 9f47de9d-364e-4427-8b37-d5720db906af not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:53:58.263643 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Attempting to bind port 86113bff-095f-4781-bc90-bf1eb7991837 on network 9f47de9d-364e-4427-8b37-d5720db906af {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:53:58.272811 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 53, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:53:58.273105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Checking segment: {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:53:58.273508 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Bound using segment: {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:53:58.273936 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Bound port: 86113bff-095f-4781-bc90-bf1eb7991837, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48817ff7-f169-4190-a1e6-86ed572c5002', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:53:58.274283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.340640 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:53:58.344706 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=86113bff-095f-4781-bc90-bf1eb7991837,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:53:58.350086 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.354866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d735cb-4d39-496c-a9a4-69bfed0fb470 req-1a69caca-518b-4932-8dcf-2b15c74b562d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:58.356373 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51d735cb-4d39-496c-a9a4-69bfed0fb470 req-1a69caca-518b-4932-8dcf-2b15c74b562d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 943 time: 0.0892005 Nov 15 17:53:58.389342 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Floating IP 751cca9b-f6db-4508-b8df-0f307eba1dd5 associated. External IP: 172.27.0.124, port: c13f1e6c-0ca0-42d7-9725-f91a42d82e8c. Nov 15 17:53:58.391853 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:58.392639 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.394069 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] 10.222.0.48 "PUT /v2.0/ports/86113bff-095f-4781-bc90-bf1eb7991837 HTTP/1.1" status: 200 len: 1093 time: 0.6135485 Nov 15 17:53:58.396541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:58.399634 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99311f5a-658d-4212-864e-0d95e02d18f5" -d '{"events": [{"name": "network-changed", "server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "tag": "86113bff-095f-4781-bc90-bf1eb7991837"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:58.438222 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6f47ca-5569-4674-999d-68951c42c4c2 service neutron] Pushing event updated for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:53:58.478256 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a64c5fb9-bd71-4654-b405-4a79e32be5d6 x-openstack-request-id: req-a64c5fb9-bd71-4654-b405-4a79e32be5d6 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:58.478596 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "tag": "86113bff-095f-4781-bc90-bf1eb7991837", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:58.478792 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a64c5fb9-bd71-4654-b405-4a79e32be5d6 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:58.479183 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837', 'status': 'completed', 'code': 200} Nov 15 17:53:58.495658 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-e5db6083-f7d8-4009-b660-cf79bd824937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:58.497211 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-e5db6083-f7d8-4009-b660-cf79bd824937 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 1096 time: 0.0533848 Nov 15 17:53:58.501793 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-51d735cb-4d39-496c-a9a4-69bfed0fb470 req-d4933461-446a-4755-b40c-c1dc3032b42a tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348846 Nov 15 17:53:58.551503 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-471c1961-dc32-4d15-a695-3f9ea828e0a0 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=86113bff-095f-4781-bc90-bf1eb7991837 HTTP/1.1" status: 200 len: 217 time: 0.0357311 Nov 15 17:53:58.610264 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-2f617a87-465c-4dfb-8881-cda1a2dbcbca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:58.611796 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-2f617a87-465c-4dfb-8881-cda1a2dbcbca service neutron] 10.222.0.48 "GET /v2.0/subnets?id=be29dea8-bad9-4c18-a288-475cbc179c1c HTTP/1.1" status: 200 len: 853 time: 0.0472720 Nov 15 17:53:58.643795 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:53:58.650226 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-e5b16bc9-fd8a-49a3-ba58-7ad447ec388f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=9f47de9d-364e-4427-8b37-d5720db906af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0285280 Nov 15 17:53:58.746167 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-8501a6d5-98e2-45b7-bbc8-a12a4af7ce2b service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869906 Nov 15 17:53:58.766930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:53:58.772685 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:53:58.785579 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:53:58.801157 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:58.801655 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c09e8972-5a72-48ac-ade0-cd02bdba49b7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "PUT /v2.0/floatingips/751cca9b-f6db-4508-b8df-0f307eba1dd5 HTTP/1.1" status: 200 len: 991 time: 1.2567809 Nov 15 17:53:58.801766 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:58.803402 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:53:58.805663 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de" -d '{"events": [{"name": "network-changed", "server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:53:58.856518 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:53:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-665ce45b-8ba3-41d4-b618-57ca6295f7aa x-openstack-request-id: req-665ce45b-8ba3-41d4-b618-57ca6295f7aa {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:53:58.856802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:53:58.857047 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-665ce45b-8ba3-41d4-b618-57ca6295f7aa {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:53:58.857435 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'status': 'completed', 'code': 200} Nov 15 17:53:58.865745 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5ab9163b-0886-4ba7-94b8-0b35b612f5d4 req-148373d6-5990-44e7-b6d1-d813e0749b3e service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1091418 Nov 15 17:53:58.920984 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-21558fce-3d1a-412d-8bd8-f0c5003a9767 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:58.922526 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-21558fce-3d1a-412d-8bd8-f0c5003a9767 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1098 time: 0.0420470 Nov 15 17:53:58.938281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:59.016932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-d1305ac8-c965-4419-8592-ae02bc08ac1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.018433 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-d1305ac8-c965-4419-8592-ae02bc08ac1e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6cd9979609f846739626991354158923&device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 1096 time: 0.0950975 Nov 15 17:53:59.083975 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-6bd07031-3b72-4a6b-9114-ad99f1066a59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.085567 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-6bd07031-3b72-4a6b-9114-ad99f1066a59 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.1546390 Nov 15 17:53:59.175189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-dd485306-37d1-491d-8f58-bbd212106a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.177167 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-dd485306-37d1-491d-8f58-bbd212106a8c service neutron] 10.222.0.48 "GET /v2.0/networks?id=9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 200 len: 914 time: 0.1501262 Nov 15 17:53:59.184524 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-003ef627-0a4b-4ed8-bcd8-6a1ec92ac72f service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 999 time: 0.0867345 Nov 15 17:53:59.195347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '751cca9b-f6db-4508-b8df-0f307eba1dd5', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:41Z', 'updated_at': '2021-11-15T17:53:58Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:59.222047 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:53:59.231008 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:53:59.231614 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:53:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:59.249906 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-a49fc689-51c9-44e5-8739-f6b111b42c32 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=86113bff-095f-4781-bc90-bf1eb7991837 HTTP/1.1" status: 200 len: 217 time: 0.0580020 Nov 15 17:53:59.297302 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-11bae912-f337-41f1-bd60-4419701dbe3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.299316 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-11bae912-f337-41f1-bd60-4419701dbe3e service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.1017787 Nov 15 17:53:59.340295 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:53:59.345853 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-7ebc7f2e-39c1-43f1-9e0c-6c118bfcc163 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.347467 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-7ebc7f2e-39c1-43f1-9e0c-6c118bfcc163 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=be29dea8-bad9-4c18-a288-475cbc179c1c HTTP/1.1" status: 200 len: 853 time: 0.0882063 Nov 15 17:53:59.388575 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-1f9b732f-c01f-4251-a6a5-fb58af801272 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=9f47de9d-364e-4427-8b37-d5720db906af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290196 Nov 15 17:53:59.391195 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-dfae77ae-932b-4f2d-bc30-8455d44df1aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.392550 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-dfae77ae-932b-4f2d-bc30-8455d44df1aa service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0806389 Nov 15 17:53:59.586442 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '751cca9b-f6db-4508-b8df-0f307eba1dd5', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:41Z', 'updated_at': '2021-11-15T17:53:58Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:53:59.614886 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e09ec25a-4f3c-4b98-9029-d9a9f00d6a4e None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '751cca9b-f6db-4508-b8df-0f307eba1dd5', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'floating_ip_address': '172.27.0.124', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:53:41Z', 'updated_at': '2021-11-15T17:53:58Z', 'revision_number': 1, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:53:59.657876 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476c04e1-c630-4a8d-9c90-f8fbf73d6321 req-d3799a11-3534-43c6-ad65-0381331b1b3e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:53:59.659527 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-476c04e1-c630-4a8d-9c90-f8fbf73d6321 req-d3799a11-3534-43c6-ad65-0381331b1b3e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 943 time: 0.0734646 Nov 15 17:53:59.716544 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-476c04e1-c630-4a8d-9c90-f8fbf73d6321 req-de302793-2611-4610-a08f-f121456f99a7 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505519 Nov 15 17:53:59.825401 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc6bd355-1046-4ee9-84f0-9921323ec641 None None] New status for floating IP 751cca9b-f6db-4508-b8df-0f307eba1dd5: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:53:59.827982 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-91510bf6-3da6-463d-be8a-ca634786ad38 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4175079 Nov 15 17:53:59.829735 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-79e13856-8b56-41c4-a804-39f6bd6d0a22 service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4270420 Nov 15 17:53:59.995210 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8b399b4a-67d7-4d12-a0c0-f12d0baf53de req-3cfcbf99-25a2-4468-b8b4-af4a90d03713 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1541989 Nov 15 17:54:00.000911 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-99311f5a-658d-4212-864e-0d95e02d18f5 req-cadeaa9e-c6d4-458e-be3b-c62ea10e2920 service neutron] 10.222.0.48 "GET /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1587756 Nov 15 17:54:00.785281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d96001b8-0556-40fa-904f-f097e7678b9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:00.833728 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08ee2f-191c-4541-a4b6-b433c9d104a6 req-77857fb5-3f59-4211-abd7-030805da0335 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:00.835231 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e08ee2f-191c-4541-a4b6-b433c9d104a6 req-77857fb5-3f59-4211-abd7-030805da0335 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 943 time: 0.0493276 Nov 15 17:54:00.886899 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e08ee2f-191c-4541-a4b6-b433c9d104a6 req-16780b25-6135-491d-a919-7fe7a6d4da83 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456195 Nov 15 17:54:02.011871 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7ddcf0-4de0-4684-a21e-c4ef7caed3c5 req-888a681d-d640-4468-ba22-7dc6cc422906 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:02.013350 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-de7ddcf0-4de0-4684-a21e-c4ef7caed3c5 req-888a681d-d640-4468-ba22-7dc6cc422906 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 943 time: 0.0524278 Nov 15 17:54:02.063407 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-de7ddcf0-4de0-4684-a21e-c4ef7caed3c5 req-7a55906e-6df5-4522-81bf-8daf09f5f135 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410910 Nov 15 17:54:02.874064 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 86113bff-095f-4781-bc90-bf1eb7991837 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:54:03.099076 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3aa5dc84-8ca6-4dfa-82a4-8bd16dcec2d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:03.132047 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=86113bff-095f-4781-bc90-bf1eb7991837,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:54:03.144008 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '86113bff-095f-4781-bc90-bf1eb7991837', 'network_id': '9f47de9d-364e-4427-8b37-d5720db906af', 'port_id': '86113bff-095f-4781-bc90-bf1eb7991837', 'mac_address': 'fa:16:3e:a3:06:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 436, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be29dea8-bad9-4c18-a288-475cbc179c1c', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:54:03.181254 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:03.185067 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b480b8-4486-412e-a48d-1144af10fc03 req-762653bd-ab7b-4feb-8a77-fd90232feb61 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:03.186600 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f8b480b8-4486-412e-a48d-1144af10fc03 req-762653bd-ab7b-4feb-8a77-fd90232feb61 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 943 time: 0.0492907 Nov 15 17:54:03.194274 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 86113bff-095f-4781-bc90-bf1eb7991837 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:54:03.213308 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=86113bff-095f-4781-bc90-bf1eb7991837,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:54:03.217879 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:03.242231 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f8b480b8-4486-412e-a48d-1144af10fc03 req-474a78c7-19fe-4c23-ab5f-4cbb7e939472 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444908 Nov 15 17:54:03.272629 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:03.481987 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['86113bff-095f-4781-bc90-bf1eb7991837'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:54:04.381906 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7cf1e-234a-4997-b97b-ab5c0ad3a3d1 req-a123e15a-1d9e-42d3-b9ff-d442e91ace90 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:04.383385 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d1d7cf1e-234a-4997-b97b-ab5c0ad3a3d1 req-a123e15a-1d9e-42d3-b9ff-d442e91ace90 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 944 time: 0.0651236 Nov 15 17:54:04.438639 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d1d7cf1e-234a-4997-b97b-ab5c0ad3a3d1 req-839b1956-6d58-4c10-bb57-cbe05c05dffc tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492401 Nov 15 17:54:04.484535 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:04.904569 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 86113bff-095f-4781-bc90-bf1eb7991837 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:54:04.972077 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 86113bff-095f-4781-bc90-bf1eb7991837 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:54:04.976030 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 86113bff-095f-4781-bc90-bf1eb7991837 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:54:04.976396 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:05.054394 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:05.076748 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:54:05.078965 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f36ec2c3-eba8-4e03-8ad4-68dfc09151b4" -d '{"events": [{"server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "name": "network-vif-plugged", "status": "completed", "tag": "86113bff-095f-4781-bc90-bf1eb7991837"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:54:05.091524 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=86113bff-095f-4781-bc90-bf1eb7991837,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:54:05.098682 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:05.125066 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:54:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ff97e7a-5d9f-4427-ad95-abea37e9b40d x-openstack-request-id: req-3ff97e7a-5d9f-4427-ad95-abea37e9b40d {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:54:05.125372 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "name": "network-vif-plugged", "status": "completed", "tag": "86113bff-095f-4781-bc90-bf1eb7991837", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:54:05.125623 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-3ff97e7a-5d9f-4427-ad95-abea37e9b40d {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:54:05.126000 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837', 'code': 200} Nov 15 17:54:05.153243 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:05.310055 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc7f7e1-6850-45bc-8c93-e24ed80ecd59 req-55beb803-3329-4ada-93ff-faf9306ec04c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:05.311584 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0dc7f7e1-6850-45bc-8c93-e24ed80ecd59 req-55beb803-3329-4ada-93ff-faf9306ec04c service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 1098 time: 0.0455811 Nov 15 17:54:05.365133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0dc7f7e1-6850-45bc-8c93-e24ed80ecd59 req-a42e0b95-3e30-414d-9f94-4755a3b1f308 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436101 Nov 15 17:54:05.566592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6095c3-b6c8-46d4-bb8a-cf8cc220c094 req-da94d1cc-10e1-4aa6-bf68-fb35066fb474 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:05.568253 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b6095c3-b6c8-46d4-bb8a-cf8cc220c094 req-da94d1cc-10e1-4aa6-bf68-fb35066fb474 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 945 time: 0.0585489 Nov 15 17:54:05.578951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:05.618653 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b6095c3-b6c8-46d4-bb8a-cf8cc220c094 req-e3e9fa2e-16e3-43a5-81b0-7b42d50d9116 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442328 Nov 15 17:54:06.675058 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:06.756815 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d6a873-f043-4b75-aa6b-7d4a779b3994 req-16be9533-b7b6-4a0e-baae-e59208bb684e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:06.758291 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9d6a873-f043-4b75-aa6b-7d4a779b3994 req-16be9533-b7b6-4a0e-baae-e59208bb684e tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 945 time: 0.0530183 Nov 15 17:54:06.805735 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9d6a873-f043-4b75-aa6b-7d4a779b3994 req-5f0f34ad-03e3-4f4d-af0a-ed491f47ad05 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411589 Nov 15 17:54:17.052317 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:54:22.357893 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:22.561543 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-aea93766-6630-411d-96d2-1e9612e57453 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0410903 Nov 15 17:54:22.633509 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd33755-792c-4306-b777-0a1625a34c35 req-df011b19-aef7-41c6-b9b8-a7032215619b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:22.634986 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-df011b19-aef7-41c6-b9b8-a7032215619b service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1098 time: 0.0471151 Nov 15 17:54:22.748517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd33755-792c-4306-b777-0a1625a34c35 req-39cfb40a-e004-4cde-89a2-f60907654013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:22.749973 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-39cfb40a-e004-4cde-89a2-f60907654013 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0914524 Nov 15 17:54:22.830077 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-39d3e7e3-2bd6-4858-8f32-c5538edbd80a service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 1001 time: 0.0610456 Nov 15 17:54:22.884547 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd33755-792c-4306-b777-0a1625a34c35 req-600d76d9-26e5-4b5d-bb87-09f75d2fb680 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:22.885945 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-600d76d9-26e5-4b5d-bb87-09f75d2fb680 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0437977 Nov 15 17:54:22.931327 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd33755-792c-4306-b777-0a1625a34c35 req-d663c0aa-9ca7-4d89-8869-36c14d947753 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:22.932830 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-d663c0aa-9ca7-4d89-8869-36c14d947753 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393875 Nov 15 17:54:23.029804 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-abcf7214-8451-40a4-b1c9-e7d39eaf1ceb service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884972 Nov 15 17:54:23.119754 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5dd33755-792c-4306-b777-0a1625a34c35 req-10c44dda-f0fd-43f0-a3db-17ecf34cbe3d service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812082 Nov 15 17:54:27.977424 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069a0fb8-c9c5-42bf-ac61-05f467c13fe9 req-46560d0d-119d-47c7-ad97-cebd5bc0f4ce tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:27.978902 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-069a0fb8-c9c5-42bf-ac61-05f467c13fe9 req-46560d0d-119d-47c7-ad97-cebd5bc0f4ce tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 945 time: 0.0554106 Nov 15 17:54:28.027170 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-069a0fb8-c9c5-42bf-ac61-05f467c13fe9 req-c1123319-1e84-469d-9642-31c62619fda0 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421951 Nov 15 17:54:29.165395 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265b9e63-5be0-47c7-a907-3d623dd77631 req-7926c424-e368-4d02-b132-4c0dfc339f82 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:29.166887 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-265b9e63-5be0-47c7-a907-3d623dd77631 req-7926c424-e368-4d02-b132-4c0dfc339f82 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 945 time: 0.0523558 Nov 15 17:54:29.218413 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-265b9e63-5be0-47c7-a907-3d623dd77631 req-3ffb50af-a68c-4940-92b6-29dd2f6f76b2 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/security-groups?id=9dfa126b-32af-4cf4-9620-4acda7be44ce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455430 Nov 15 17:54:29.764698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-96ba543c-2ee9-4ff9-8210-ffcd3949c2e9 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:29.766042 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-96ba543c-2ee9-4ff9-8210-ffcd3949c2e9 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 945 time: 0.0629506 Nov 15 17:54:29.861646 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Deleting port 86113bff-095f-4781-bc90-bf1eb7991837 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:54:29.861995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:29.952973 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] For port 86113bff-095f-4781-bc90-bf1eb7991837, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=86113bff-095f-4781-bc90-bf1eb7991837,segment=NetworkSegment(48817ff7-f169-4190-a1e6-86ed572c5002),segment_id=48817ff7-f169-4190-a1e6-86ed572c5002)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:54:29.953333 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:29.966150 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Calling delete_port for 86113bff-095f-4781-bc90-bf1eb7991837 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:54:30.094369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:30.107802 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['86113bff-095f-4781-bc90-bf1eb7991837'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:54:30.127329 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Pushing event deleted for resources: {'Port': ['ID=86113bff-095f-4781-bc90-bf1eb7991837,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:30.166967 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] No DVR routers for this DVR port 86113bff-095f-4781-bc90-bf1eb7991837 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:54:30.169862 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:30.173219 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-356b1131-0fd2-4cab-97a1-fdaca9d7bee3 req-441b8aa3-965d-47e3-a5a6-88c0faf3bf3d tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.48 "DELETE /v2.0/ports/86113bff-095f-4781-bc90-bf1eb7991837 HTTP/1.1" status: 204 len: 173 time: 0.4005084 Nov 15 17:54:30.173656 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'name': 'network-vif-deleted', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:54:30.175923 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-634279c1-e7dc-4995-a6b6-ffde8ebd63be" -d '{"events": [{"server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "name": "network-vif-deleted", "tag": "86113bff-095f-4781-bc90-bf1eb7991837"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:54:30.215103 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:54:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-88d192a2-7963-4fcc-9911-39219a31a4f0 x-openstack-request-id: req-88d192a2-7963-4fcc-9911-39219a31a4f0 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:54:30.215396 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf90ae64-ca03-4908-a595-7f800e6f1b46", "name": "network-vif-deleted", "tag": "86113bff-095f-4781-bc90-bf1eb7991837", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:54:30.215642 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-88d192a2-7963-4fcc-9911-39219a31a4f0 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:54:30.216069 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf90ae64-ca03-4908-a595-7f800e6f1b46', 'name': 'network-vif-deleted', 'tag': '86113bff-095f-4781-bc90-bf1eb7991837', 'status': 'completed', 'code': 200} Nov 15 17:54:30.335679 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-997ac492-28cd-4e8e-aef5-557827517bb2 req-ee729679-1f4b-4282-b582-129064504274 tempest-VolumesSnapshotTestJSON-841363356 tempest-VolumesSnapshotTestJSON-841363356-project] 10.222.0.31 "GET /v2.0/ports?device_id=cf90ae64-ca03-4908-a595-7f800e6f1b46 HTTP/1.1" status: 200 len: 210 time: 0.0268023 Nov 15 17:54:30.777285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2f1cd60a-814d-495a-a930-01e9a4ca2716 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:33.098286 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-75d4877a-3a53-40d3-a426-f54146196f11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:34.479023 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:35.588119 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:35.842587 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 86113bff-095f-4781-bc90-bf1eb7991837 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:54:35.872951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 86113bff-095f-4781-bc90-bf1eb7991837 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:54:35.873295 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 86113bff-095f-4781-bc90-bf1eb7991837 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:54:36.671547 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:47.859076 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c69cbb7-ad1a-4386-a408-7370a1aed070 req-8518407f-f723-4d54-b393-0965b5df227e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:47.860617 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c69cbb7-ad1a-4386-a408-7370a1aed070 req-8518407f-f723-4d54-b393-0965b5df227e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0535665 Nov 15 17:54:47.915326 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c69cbb7-ad1a-4386-a408-7370a1aed070 req-4932d830-879f-4a73-810c-8b2511c33471 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478704 Nov 15 17:54:49.045757 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bcd5b6-2ff6-4e1f-bcf3-f53d2225af93 req-a1b3a556-7509-4397-8ee7-e7eeed9a7f51 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:49.047275 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0bcd5b6-2ff6-4e1f-bcf3-f53d2225af93 req-a1b3a556-7509-4397-8ee7-e7eeed9a7f51 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0492852 Nov 15 17:54:49.096396 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0bcd5b6-2ff6-4e1f-bcf3-f53d2225af93 req-c2845a97-5501-4aa1-8141-4db5bc20bbaf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431149 Nov 15 17:54:50.222845 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09544566-b639-42c6-bacb-afea6191e9a1 req-e5f7da13-4818-4e98-95f6-fb4772a99893 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:50.224379 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-09544566-b639-42c6-bacb-afea6191e9a1 req-e5f7da13-4818-4e98-95f6-fb4772a99893 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0497351 Nov 15 17:54:50.275156 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-09544566-b639-42c6-bacb-afea6191e9a1 req-afff6b04-ceaa-4d8d-b73b-e9bb89cbb8c6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448315 Nov 15 17:54:51.420041 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4168da2c-2fe4-4c34-ae2e-c3c3f1ce8299 req-4eeedae6-b3e6-461e-94bc-fb8584d3853a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:51.421551 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4168da2c-2fe4-4c34-ae2e-c3c3f1ce8299 req-4eeedae6-b3e6-461e-94bc-fb8584d3853a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0568440 Nov 15 17:54:51.476640 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4168da2c-2fe4-4c34-ae2e-c3c3f1ce8299 req-8bac7abe-92fa-4bcb-bc1f-7e9f933fcbce tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487473 Nov 15 17:54:52.353790 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:52.608337 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e426c5-f3a9-4398-bf1c-749a1ed8cf01 req-a28f5581-f105-4a13-8882-a0b90387da65 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:52.609884 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55e426c5-f3a9-4398-bf1c-749a1ed8cf01 req-a28f5581-f105-4a13-8882-a0b90387da65 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0592480 Nov 15 17:54:52.657574 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-55e426c5-f3a9-4398-bf1c-749a1ed8cf01 req-0a1adbbc-98ab-47ab-9a9a-0c807f28aac8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416255 Nov 15 17:54:53.635389 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60382) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:54:53.683227 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Deleting subnet be29dea8-bad9-4c18-a288-475cbc179c1c {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:54:53.686619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:53.726282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:53.795351 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:53.832300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8cb228-211b-4f1c-9e0a-2fd01d51b086 req-83d34431-c7bc-42f2-a4af-1e5656913bc0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:53.833761 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e8cb228-211b-4f1c-9e0a-2fd01d51b086 req-83d34431-c7bc-42f2-a4af-1e5656913bc0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0870399 Nov 15 17:54:53.874442 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:53.908304 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=be29dea8-bad9-4c18-a288-475cbc179c1c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:53.918484 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3e8cb228-211b-4f1c-9e0a-2fd01d51b086 req-8dcab5cd-6100-4d86-93e4-4479bfe6ef94 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0786893 Nov 15 17:54:53.921162 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.921486 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.921812 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.922144 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.922425 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.922756 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.923066 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.923379 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.923691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.924024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.924731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.924731 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:53.927398 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:53.930535 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-963b1075-6709-4a11-8730-929c57c3a3e3 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/be29dea8-bad9-4c18-a288-475cbc179c1c HTTP/1.1" status: 204 len: 168 time: 0.2941320 Nov 15 17:54:53.933404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60386) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:54:54.005189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.054235 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:54:54.097543 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.117300 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f47de9d-364e-4427-8b37-d5720db906af']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:54.126335 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48817ff7-f169-4190-a1e6-86ed572c5002') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:54.126627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48817ff7-f169-4190-a1e6-86ed572c5002') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:54.135743 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.148646 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.155098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Releasing vlan 436 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:54:54.155444 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:54:54.157281 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:54:54.216116 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.222922 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.228128 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] 10.222.0.31 "DELETE /v2.0/networks/9f47de9d-364e-4427-8b37-d5720db906af HTTP/1.1" status: 204 len: 168 time: 0.2936521 Nov 15 17:54:54.239898 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Pushing event deleted for resources: {'Network': ['ID=9f47de9d-364e-4427-8b37-d5720db906af,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:54.248294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.248648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.248974 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.249307 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.249643 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.249965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.250475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.250743 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.251065 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.251390 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.251719 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.252044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c2dd7e6-0001-4a00-b876-7076f0e78ddf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:54:54.340240 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60390) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:54:54.385495 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8afedea2-e93e-45b6-bc52-71f770c20f17 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6cd9979609f846739626991354158923&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0438941 Nov 15 17:54:54.388287 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60392) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:54:54.437002 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.457376 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.512299 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.514790 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:54.515967 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9dfa126b-32af-4cf4-9620-4acda7be44ce HTTP/1.1" status: 204 len: 168 time: 0.1266840 Nov 15 17:54:54.523723 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733de3b7-d046-485d-a9d8-d35edf35add7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dfa126b-32af-4cf4-9620-4acda7be44ce,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:55.065521 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d147fd-c61c-438d-9264-bb8ebfcfe540 req-e135b64b-4bee-4078-9c7c-f5bcd5531df2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:55.066998 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e3d147fd-c61c-438d-9264-bb8ebfcfe540 req-e135b64b-4bee-4078-9c7c-f5bcd5531df2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0586460 Nov 15 17:54:55.115464 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e3d147fd-c61c-438d-9264-bb8ebfcfe540 req-43a40dc1-dbf9-4a54-abd8-046ee17de2fd tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423062 Nov 15 17:54:56.235478 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4194eb26-f363-4fc7-a532-70a47aac9212 req-9eb5691c-95e7-44d6-9a56-b14e5cc007a9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:56.237017 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4194eb26-f363-4fc7-a532-70a47aac9212 req-9eb5691c-95e7-44d6-9a56-b14e5cc007a9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0488920 Nov 15 17:54:56.284775 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4194eb26-f363-4fc7-a532-70a47aac9212 req-eec266d4-6494-4206-9d76-030506f78dc9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414274 Nov 15 17:54:56.607384 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6d155a-2a08-43d0-b926-0c3128a4bb09 req-13fe0585-34ce-4244-a83f-9b7fb99cef51 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:56.608836 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f6d155a-2a08-43d0-b926-0c3128a4bb09 req-13fe0585-34ce-4244-a83f-9b7fb99cef51 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0587478 Nov 15 17:54:56.661665 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f6d155a-2a08-43d0-b926-0c3128a4bb09 req-d84438bf-41b9-4bcf-adb1-0eb1a612d3b8 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437498 Nov 15 17:54:57.433734 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dad3515-6c48-4fab-be59-a8f076edc847 req-a816b49a-a4b6-42a6-9d88-ab692579c750 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:57.435223 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2dad3515-6c48-4fab-be59-a8f076edc847 req-a816b49a-a4b6-42a6-9d88-ab692579c750 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0579109 Nov 15 17:54:57.483873 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2dad3515-6c48-4fab-be59-a8f076edc847 req-3c0d03c5-4b6f-47ce-9073-873ad758cbc8 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422816 Nov 15 17:54:57.783366 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f74ca83-06c1-4f10-8c8d-941ce2303795 req-73a937d2-f60f-4250-922e-837332fc4aac tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:57.784866 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6f74ca83-06c1-4f10-8c8d-941ce2303795 req-73a937d2-f60f-4250-922e-837332fc4aac tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0501966 Nov 15 17:54:57.832029 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6f74ca83-06c1-4f10-8c8d-941ce2303795 req-3cde30e9-9bbb-451f-8aa8-720a7fed5bff tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups?id=52caeb19-493c-4fbf-a742-97c911021216&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410507 Nov 15 17:54:58.266802 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-01087b40-7f4b-4297-b853-fd6535bacb78 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:58.268330 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-01087b40-7f4b-4297-b853-fd6535bacb78 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 945 time: 0.0576081 Nov 15 17:54:58.367117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Deleting port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:54:58.367423 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:58.461680 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] For port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:54:58.462050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:58.614646 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682febc8-8106-4c2d-9506-d94bf376b368 req-afcc3a1e-9764-4f54-aab5-a7acbba7a816 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:58.616323 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-682febc8-8106-4c2d-9506-d94bf376b368 req-afcc3a1e-9764-4f54-aab5-a7acbba7a816 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0530212 Nov 15 17:54:58.633724 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:58.634070 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:58.634379 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Floating IP c82bba7b-808d-4bc0-9106-e5e7828ce50d disassociated. External IP: 172.27.0.11, port: bbb87da9-bfbe-470d-bf32-ec2b93afbbb3. Nov 15 17:54:58.634745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Calling delete_port for bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:54:58.668609 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-682febc8-8106-4c2d-9506-d94bf376b368 req-04a88fa2-1b7e-43a5-a6ee-04674c3929da tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460300 Nov 15 17:54:58.765173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:58.792622 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'Port': ['ID=bbb87da9-bfbe-470d-bf32-ec2b93afbbb3,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:54:58.907954 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:54:58.937046 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18745f9f-780f-44d6-aff8-e6884825022a req-5a9db96e-5b6c-4b40-bc63-dc2dfeb0ba7f tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/ports?device_id=37a0bc6d-08c7-4357-a122-2c0e557973a0 HTTP/1.1" status: 200 len: 210 time: 0.0257323 Nov 15 17:54:59.013705 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:54:59.023899 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:54:59.035028 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:54:59.035653 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:54:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:59.049738 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] No DVR routers for this DVR port bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:54:59.052296 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:54:59.055609 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-dfcff863-0d70-4fc1-a641-a219fdbad3d8 req-c81e9299-b51b-4010-a87f-9e4a148bbb09 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.48 "DELETE /v2.0/ports/bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 HTTP/1.1" status: 204 len: 173 time: 0.7781203 Nov 15 17:54:59.056081 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'name': 'network-vif-deleted', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:54:59.058291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7fddb46-4538-4288-bfe6-d94c39064406" -d '{"events": [{"server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "name": "network-vif-deleted", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:54:59.097832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:54:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6fdc33c-375e-4612-8f45-45ce56c4d0aa x-openstack-request-id: req-a6fdc33c-375e-4612-8f45-45ce56c4d0aa {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:54:59.098122 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37a0bc6d-08c7-4357-a122-2c0e557973a0", "name": "network-vif-deleted", "tag": "bbb87da9-bfbe-470d-bf32-ec2b93afbbb3", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:54:59.098366 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a6fdc33c-375e-4612-8f45-45ce56c4d0aa {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:54:59.098774 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37a0bc6d-08c7-4357-a122-2c0e557973a0', 'name': 'network-vif-deleted', 'tag': 'bbb87da9-bfbe-470d-bf32-ec2b93afbbb3', 'status': 'completed', 'code': 200} Nov 15 17:54:59.146766 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:54:59.355092 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:59.386938 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:54:59.396621 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:54:59.397220 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:54:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:59.522195 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:54:59.739935 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:54:59.774228 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d62684-5d80-41c8-8171-3dc8d3e1aa5d None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:48:24Z', 'revision_number': 4, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'ff012446-3d0c-4470-b9d0-f62a14c057a8', 'name': '', 'network_id': 'e40bb745-7523-4329-91e3-c55442c5a8fa', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'mac_address': 'fa:16:3e:7c:af:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:22Z', 'updated_at': '2021-11-15T17:48:32Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'subnets': [{'id': 'ceb6358c-736e-42b9-8a34-e129c4912f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:54:59.810605 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d097467d-2e9f-44c8-bf9d-f2e0eec86c51 req-7fac58c0-8848-49b2-ba26-9cff56c8155a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:54:59.811385 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d097467d-2e9f-44c8-bf9d-f2e0eec86c51 req-7fac58c0-8848-49b2-ba26-9cff56c8155a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0513816 Nov 15 17:54:59.869757 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d097467d-2e9f-44c8-bf9d-f2e0eec86c51 req-cae6e21e-e286-415f-b84a-d791d51f6e20 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464985 Nov 15 17:55:00.032135 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60454) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:00.047197 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298c605c-41e2-4f4d-8726-0cb1483ed6f5 None None] New status for floating IP c82bba7b-808d-4bc0-9106-e5e7828ce50d: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:55:00.097096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.130319 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.189126 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.192089 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.193547 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "DELETE /v2.0/security-groups/52caeb19-493c-4fbf-a742-97c911021216 HTTP/1.1" status: 204 len: 168 time: 0.1603961 Nov 15 17:55:00.196383 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60462) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:00.226442 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.api.v2.resource [None req-b123e4b7-869e-4862-ada4-ebe56252bc44 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] show failed (client error): The resource could not be found. Nov 15 17:55:00.227491 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b123e4b7-869e-4862-ada4-ebe56252bc44 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "GET /v2.0/security-groups/52caeb19-493c-4fbf-a742-97c911021216 HTTP/1.1" status: 404 len: 347 time: 0.0299175 Nov 15 17:55:00.235460 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60464) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:00.249548 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-275f2379-bba6-4105-b9e9-bbf3a216c5e6 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=52caeb19-493c-4fbf-a742-97c911021216,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:00.409654 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Deleting port 27a4afc1-13df-438c-a76f-dd0c4b05d7ac {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:00.409989 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.518239 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.518991 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.554665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Calling delete_port for 27a4afc1-13df-438c-a76f-dd0c4b05d7ac owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:00.767831 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.792316 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-abfa5220-0434-4a07-8f2f-036609f9de30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.804952 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Pushing event deleted for resources: {'Port': ['ID=27a4afc1-13df-438c-a76f-dd0c4b05d7ac,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:00.893493 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.904479 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:00.906059 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c5ae6f20-fa52-4706-b92e-f46c600de528 tempest-AttachVolumeTestJSON-1928488255 tempest-AttachVolumeTestJSON-1928488255-project] 10.222.0.31 "DELETE /v2.0/floatingips/c82bba7b-808d-4bc0-9106-e5e7828ce50d HTTP/1.1" status: 204 len: 168 time: 0.6696012 Nov 15 17:55:01.063480 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7478d1-e583-4c66-be60-d06284c07c64 req-ff7f6584-05e5-449f-b403-8b211db68fa7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:01.065352 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1a7478d1-e583-4c66-be60-d06284c07c64 req-ff7f6584-05e5-449f-b403-8b211db68fa7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0828803 Nov 15 17:55:01.138005 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1a7478d1-e583-4c66-be60-d06284c07c64 req-a160bc36-e360-4a68-8a79-ee60ed428252 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645313 Nov 15 17:55:01.212043 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:55:01.331716 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:01.344059 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:55:01.383520 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:01.397446 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:01.418367 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:01.424664 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:01.477875 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=6']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:01.486201 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.486482 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.486825 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.487160 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.487507 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.487846 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.488174 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.488494 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.488934 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.489155 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.489463 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.489783 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:01.509673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:55:02.281869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0dcae9-d9af-4e7f-bc13-a722225df3df req-0b5a31de-124d-4460-b313-0d7e76bcadf1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:02.289976 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ab0dcae9-d9af-4e7f-bc13-a722225df3df req-0b5a31de-124d-4460-b313-0d7e76bcadf1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0581472 Nov 15 17:55:02.334772 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ab0dcae9-d9af-4e7f-bc13-a722225df3df req-1eb329b1-68f8-4632-9504-4afb5e5ce2cc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437088 Nov 15 17:55:03.093338 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a9da8395-f61a-472b-8f54-c6e6dad75ff9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:03.219798 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:03.279426 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:03.279829 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:03.388546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:03.438951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:03.441461 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0febf31-b057-4fb5-b9a2-b1d9d66aa292" -d '{"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:03.468684 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:03.473820 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:03.474726 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:03.500456 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a843a138-c5cb-40ec-ae0c-080381f61ca8 x-openstack-request-id: req-a843a138-c5cb-40ec-ae0c-080381f61ca8 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:03.500851 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:03.501107 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a843a138-c5cb-40ec-ae0c-080381f61ca8 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:03.501596 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'code': 200} Nov 15 17:55:03.523534 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:03.523534 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device bbb87da9-bfbe-470d-bf32-ec2b93afbbb3 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:03.542935 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4ed67b-f66c-4aca-8705-946da3134db7 req-0ccddb6c-6776-4ee9-9a63-32bc8e09387f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:03.544454 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c4ed67b-f66c-4aca-8705-946da3134db7 req-0ccddb6c-6776-4ee9-9a63-32bc8e09387f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.1209252 Nov 15 17:55:03.551995 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=7']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:03.603052 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2c4ed67b-f66c-4aca-8705-946da3134db7 req-9f30e9d5-f160-491f-a412-75421e98b2aa tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477009 Nov 15 17:55:04.475169 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:04.626281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60518) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:04.754298 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910b1393-9dc3-499a-9bf7-2414138e5f37 req-7d6f20e8-e1d1-4cdb-b901-35c5aefd55f6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:04.755958 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-910b1393-9dc3-499a-9bf7-2414138e5f37 req-7d6f20e8-e1d1-4cdb-b901-35c5aefd55f6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0591078 Nov 15 17:55:04.809695 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-910b1393-9dc3-499a-9bf7-2414138e5f37 req-a3442f0d-1016-4da3-a66f-81fe585addee tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470743 Nov 15 17:55:05.523312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:05.596818 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:05.873037 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Deleting port ff012446-3d0c-4470-b9d0-f62a14c057a8 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:05.873642 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:05.994960 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c42e174-949a-46a5-93d2-367e43c98d1a req-082d3fd5-dbf9-410b-aa53-34ad2d30020e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:05.996659 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3c42e174-949a-46a5-93d2-367e43c98d1a req-082d3fd5-dbf9-410b-aa53-34ad2d30020e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0821650 Nov 15 17:55:06.028372 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] For port ff012446-3d0c-4470-b9d0-f62a14c057a8, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=ff012446-3d0c-4470-b9d0-f62a14c057a8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:06.028761 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:06.053265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Calling delete_port for ff012446-3d0c-4470-b9d0-f62a14c057a8 owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:06.113794 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3c42e174-949a-46a5-93d2-367e43c98d1a req-1404eb7e-e6b8-420b-9fdf-abddcbc9b4cf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1088963 Nov 15 17:55:06.267066 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:06.295988 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Pushing event deleted for resources: {'Port': ['ID=ff012446-3d0c-4470-b9d0-f62a14c057a8,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:06.492643 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:06.669419 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:06.724593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Router 157002b9-ee54-4569-938f-37ce4b4383a6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:55:06.839480 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:06.845217 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-03400151-49e9-460c-b858-ed05795f36ec admin admin] 10.222.0.31 "PUT /v2.0/routers/157002b9-ee54-4569-938f-37ce4b4383a6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2171922 Nov 15 17:55:06.847888 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60530) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:06.848681 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Sync routers for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:06.870554 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:06.871586 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:06.963956 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.105426 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.154791 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:07.190463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Deleting port 4f2826aa-a6d2-4363-87c3-ee772c11656c {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:07.191058 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.311230 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a78735-752f-42d0-9df2-23d887a22e63 req-03f0cc97-bf0a-445e-96ba-432993179a56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:07.313214 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a6a78735-752f-42d0-9df2-23d887a22e63 req-03f0cc97-bf0a-445e-96ba-432993179a56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0776021 Nov 15 17:55:07.337453 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] For port 4f2826aa-a6d2-4363-87c3-ee772c11656c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=4f2826aa-a6d2-4363-87c3-ee772c11656c,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:07.338094 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.361167 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Calling delete_port for 4f2826aa-a6d2-4363-87c3-ee772c11656c owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:07.385144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113'}], 'enable_snat': True}, 'gw_port_id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:55:06Z', 'revision_number': 5, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port': {'id': '4f2826aa-a6d2-4363-87c3-ee772c11656c', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:f6:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:48:14Z', 'updated_at': '2021-11-15T17:48:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:07.393470 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a6a78735-752f-42d0-9df2-23d887a22e63 req-77d0ffce-1107-4991-9a9e-1abc58ca5668 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690057 Nov 15 17:55:07.412644 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Checking router: 157002b9-ee54-4569-938f-37ce4b4383a6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:07.422165 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Routers {'157002b9-ee54-4569-938f-37ce4b4383a6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:07.422971 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['157002b9-ee54-4569-938f-37ce4b4383a6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:07.533368 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] Set router 157002b9-ee54-4569-938f-37ce4b4383a6 gateway port host: None {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:07.591720 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:55:07Z', 'revision_number': 6, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:07.594340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.619916 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d67efe0d-9494-47bc-84bd-e63ef28b9dd7 None None] The sync data for ids ['157002b9-ee54-4569-938f-37ce4b4383a6'] in dv-cinder-788366-7-iscsi is: [{'id': '157002b9-ee54-4569-938f-37ce4b4383a6', 'name': 'tempest-AttachVolumeTestJSON-1549537088-router', 'tenant_id': '230fd761d538456998d7b335d14192ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:48:12Z', 'updated_at': '2021-11-15T17:55:07Z', 'revision_number': 6, 'project_id': '230fd761d538456998d7b335d14192ff', 'gw_port_host': None}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:07.621200 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Pushing event deleted for resources: {'Port': ['ID=4f2826aa-a6d2-4363-87c3-ee772c11656c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:07.713912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.804577 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.806857 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.851124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.851866 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 157002b9-ee54-4569-938f-37ce4b4383a6 {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:55:07.857117 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.859604 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e75828ee-ead4-4b83-8297-424be656078a admin admin] 10.222.0.31 "DELETE /v2.0/routers/157002b9-ee54-4569-938f-37ce4b4383a6 HTTP/1.1" status: 204 len: 168 time: 1.0094812 Nov 15 17:55:07.862114 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60534) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:07.914662 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Deleting subnet ceb6358c-736e-42b9-8a34-e129c4912f6f {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:55:07.918507 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:07.953167 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.069613 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.138354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.167230 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ceb6358c-736e-42b9-8a34-e129c4912f6f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:08.169501 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.176203 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9bb5aec-a365-4099-bf8e-c47a03247dd4 None None] Network e40bb745-7523-4329-91e3-c55442c5a8fa requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:55:08.176734 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60536) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:08.177588 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c928f6f4-2494-4193-a9cf-a7950e9dc372 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/ceb6358c-736e-42b9-8a34-e129c4912f6f HTTP/1.1" status: 204 len: 168 time: 0.3133242 Nov 15 17:55:08.271743 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.340564 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Deleting port 2a87eac5-663e-420c-953d-9ce7085ab1c8 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:08.340907 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.407580 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] For port 2a87eac5-663e-420c-953d-9ce7085ab1c8, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=2a87eac5-663e-420c-953d-9ce7085ab1c8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:08.407858 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.420634 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Calling delete_port for 2a87eac5-663e-420c-953d-9ce7085ab1c8 owned by network:dhcp {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:08.479486 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] DHCP port deletion for e40bb745-7523-4329-91e3-c55442c5a8fa request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:55:08.590332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Deleting port 2a87eac5-663e-420c-953d-9ce7085ab1c8 {{(pid=108143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:08.591249 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.601052 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215eb147-bbda-4038-ae28-affd9fb7e503 req-4c84aa86-62ce-40c0-80b2-a1cb9fab31a1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:08.602702 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-215eb147-bbda-4038-ae28-affd9fb7e503 req-4c84aa86-62ce-40c0-80b2-a1cb9fab31a1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0724888 Nov 15 17:55:08.639584 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.677493 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] For port 2a87eac5-663e-420c-953d-9ce7085ab1c8, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=2a87eac5-663e-420c-953d-9ce7085ab1c8,segment=NetworkSegment(65df5835-7d4f-417d-9f6f-35166467b466),segment_id=65df5835-7d4f-417d-9f6f-35166467b466)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:08.678464 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.682308 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Pushing event deleted for resources: {'Port': ['ID=2a87eac5-663e-420c-953d-9ce7085ab1c8,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:08.695155 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] No DVR routers for this DVR port 2a87eac5-663e-420c-953d-9ce7085ab1c8 on host dv-cinder-788366-7-iscsi {{(pid=108141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:55:08.702512 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Calling delete_port for 2a87eac5-663e-420c-953d-9ce7085ab1c8 owned by network:dhcp {{(pid=108143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:08.820403 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-215eb147-bbda-4038-ae28-affd9fb7e503 req-574f46be-a598-4aae-8f13-c36189f65f9e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2070572 Nov 15 17:55:08.822063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.863380 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e40bb745-7523-4329-91e3-c55442c5a8fa']}} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:08.873730 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65df5835-7d4f-417d-9f6f-35166467b466') {'for_net_delete': True} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:08.874064 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65df5835-7d4f-417d-9f6f-35166467b466') {} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:08.878359 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527'] for port, after_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.892221 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59181159'] for segment, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.910407 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.918090 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Releasing vlan 409 on physical network physnet1 to pool {{(pid=108141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:55:08.918421 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59170109'] for segment, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:08.924475 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] No DVR routers for this DVR port 2a87eac5-663e-420c-953d-9ce7085ab1c8 on host dv-cinder-788366-7-iscsi {{(pid=108143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:55:08.929022 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44e8158-596f-4bf9-9ebc-a8e590935b23 None None] Pushing event deleted for resources: {'Port': ['ID=2a87eac5-663e-420c-953d-9ce7085ab1c8,revision_number=None']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: Traceback (most recent call last): Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: timer() Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: cb(*args, **kw) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: return func(*args, **kwargs) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: self._notify() Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: self.callback(batched_events) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: event.method(event) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: return f(self, *a, **k) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._get(url).json() Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: return self.request(url, 'GET', **kwargs) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:55:08.992934 dv-cinder-788366-7-iscsi neutron-server[108141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:55:09.009684 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.015673 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.022030 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] 10.222.0.31 "DELETE /v2.0/networks/e40bb745-7523-4329-91e3-c55442c5a8fa HTTP/1.1" status: 204 len: 168 time: 0.8443799 Nov 15 17:55:09.035281 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0221674-f206-4ecc-8296-127269588614 admin admin] Pushing event deleted for resources: {'Network': ['ID=e40bb745-7523-4329-91e3-c55442c5a8fa,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:09.171617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60542) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:09.219497 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b3359588-ae10-4621-817b-538625b3444e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=230fd761d538456998d7b335d14192ff&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0465868 Nov 15 17:55:09.222011 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60544) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:09.281878 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.324468 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.372244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.375821 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:09.377323 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ab736546-634e-4bae-bc84-334ff5d7767f HTTP/1.1" status: 204 len: 168 time: 0.1540074 Nov 15 17:55:09.386481 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b96b9a6-7b7b-4e19-b551-7f0edbc4a4bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab736546-634e-4bae-bc84-334ff5d7767f,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:09.597139 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 4f2826aa-a6d2-4363-87c3-ee772c11656c no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:09.627857 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 4f2826aa-a6d2-4363-87c3-ee772c11656c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:09.628299 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 4f2826aa-a6d2-4363-87c3-ee772c11656c not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:09.629894 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device ff012446-3d0c-4470-b9d0-f62a14c057a8 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:09.649194 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: ff012446-3d0c-4470-b9d0-f62a14c057a8 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:09.649632 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device ff012446-3d0c-4470-b9d0-f62a14c057a8 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:09.650125 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 2a87eac5-663e-420c-953d-9ce7085ab1c8 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:09.675990 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 2a87eac5-663e-420c-953d-9ce7085ab1c8 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:09.676445 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 2a87eac5-663e-420c-953d-9ce7085ab1c8 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:09.962768 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f094d2b-4f9e-4161-b235-9e75e58c7b83 req-baeb7ff4-6699-4497-b842-749fc01530c0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:09.964825 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f094d2b-4f9e-4161-b235-9e75e58c7b83 req-baeb7ff4-6699-4497-b842-749fc01530c0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0525942 Nov 15 17:55:10.034324 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f094d2b-4f9e-4161-b235-9e75e58c7b83 req-bf2191f7-2e0e-4b81-8fb0-f6ac1cc5aa40 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0615864 Nov 15 17:55:10.805109 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-a4539c93-9fdf-4ef2-a541-9d6af4f23117 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:10.806630 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-a4539c93-9fdf-4ef2-a541-9d6af4f23117 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1098 time: 0.0428514 Nov 15 17:55:10.900093 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-daef8f92-8c21-44cc-b77f-deb8210963b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:10.901495 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-daef8f92-8c21-44cc-b77f-deb8210963b2 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.0872197 Nov 15 17:55:10.967365 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-00ba3d83-3d88-4884-b4c7-2568b5d9b220 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 1001 time: 0.0584712 Nov 15 17:55:11.022280 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-7725baab-ea89-4a44-b713-7e1c2f01a4b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:11.023729 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-7725baab-ea89-4a44-b713-7e1c2f01a4b2 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0478714 Nov 15 17:55:11.068006 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-d913fbb1-1402-4475-97e3-68acf0475329 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:11.069431 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-d913fbb1-1402-4475-97e3-68acf0475329 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382257 Nov 15 17:55:11.158979 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-00ce8673-2da3-4213-be1b-9ff08d4cdb31 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813284 Nov 15 17:55:11.167338 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38bed1e2-fa49-4746-ab0d-9d2b5f62b3ab req-337c578d-d719-49c4-a563-314d50aa1b79 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:11.168830 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-38bed1e2-fa49-4746-ab0d-9d2b5f62b3ab req-337c578d-d719-49c4-a563-314d50aa1b79 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0507281 Nov 15 17:55:11.217915 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-38bed1e2-fa49-4746-ab0d-9d2b5f62b3ab req-1b953b3f-39e1-44d3-9df1-361deee2288b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428152 Nov 15 17:55:11.258479 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b660eabd-32bf-4e88-b0b4-a6c0e656bae9 req-6f6fbdcb-fa51-4581-8df6-f9e8ec55da98 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864785 Nov 15 17:55:12.355739 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52cead00-2617-43d9-a916-d19da49ae9b8 req-12aa44c5-ee4b-4143-ad69-3ee59f1ef27c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:12.357210 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-52cead00-2617-43d9-a916-d19da49ae9b8 req-12aa44c5-ee4b-4143-ad69-3ee59f1ef27c tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0561702 Nov 15 17:55:12.411496 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-52cead00-2617-43d9-a916-d19da49ae9b8 req-b73d71b6-a1c2-4c76-8568-6f94523aa086 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447791 Nov 15 17:55:13.269926 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60624) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:13.392591 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a430963-0e6a-4542-bea0-cd1830649da5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.719691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd48eff3-5cbf-40d3-8174-a99c4fe53489 req-9b09f0aa-bd9e-4019-bc0a-804e6f1c3772 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:13.721269 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fd48eff3-5cbf-40d3-8174-a99c4fe53489 req-9b09f0aa-bd9e-4019-bc0a-804e6f1c3772 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0831776 Nov 15 17:55:13.730579 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a430963-0e6a-4542-bea0-cd1830649da5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.737511 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2a430963-0e6a-4542-bea0-cd1830649da5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.789788 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2a430963-0e6a-4542-bea0-cd1830649da5 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cc7991779b69458a8b57ccc04387821b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5187409 Nov 15 17:55:13.792751 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a430963-0e6a-4542-bea0-cd1830649da5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e65dc3d-e7f3-4a61-a6aa-5951f212b0e8,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:13.792934 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60630) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:13.809606 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fd48eff3-5cbf-40d3-8174-a99c4fe53489 req-e2672348-081d-4283-8acc-423853278d57 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809937 Nov 15 17:55:13.843483 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.865351 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.912870 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.916364 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:13.917473 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7e65dc3d-e7f3-4a61-a6aa-5951f212b0e8 HTTP/1.1" status: 204 len: 168 time: 0.1236594 Nov 15 17:55:13.925502 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1418cefa-9bcf-4bd5-a1ec-87325055eb9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e65dc3d-e7f3-4a61-a6aa-5951f212b0e8,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:14.603212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [req-d3861bdb-57c4-42b5-a5e9-67658f050e0c req-b1ab5a3e-c5b3-474e-b5f3-9237adae17ce service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:55:14.604901 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d3861bdb-57c4-42b5-a5e9-67658f050e0c req-b1ab5a3e-c5b3-474e-b5f3-9237adae17ce service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061181 Nov 15 17:55:14.778474 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fdaf9fa-d2e9-42d1-b4b6-7e09df94ff20 req-cdeb3b3c-e093-4018-b7ce-518d87cb691b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:14.780226 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fdaf9fa-d2e9-42d1-b4b6-7e09df94ff20 req-cdeb3b3c-e093-4018-b7ce-518d87cb691b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 945 time: 0.0550971 Nov 15 17:55:14.810592 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-a6930755-041d-4597-9414-91c660d0efd1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0469034 Nov 15 17:55:14.830682 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fdaf9fa-d2e9-42d1-b4b6-7e09df94ff20 req-bf20cc81-d2db-486b-90d1-f6379055a50d tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442576 Nov 15 17:55:15.304788 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:15.392294 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:15.415401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:15.417762 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42a59150-41c6-4821-a3eb-34f5ccb729cf" -d '{"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-unplugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:15.430663 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:15.436673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:15.461020 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ec7ade4-acde-4204-86d7-b3fe8e9e1433 x-openstack-request-id: req-5ec7ade4-acde-4204-86d7-b3fe8e9e1433 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:15.461336 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-unplugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:15.461597 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-5ec7ade4-acde-4204-86d7-b3fe8e9e1433 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:15.461982 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'code': 200} Nov 15 17:55:15.487039 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=8']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:15.573506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ca73dd-c933-49f5-9194-c45af432a368 req-4917908f-1c90-42b8-bb20-aa4e2ee968e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:15.575045 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-4917908f-1c90-42b8-bb20-aa4e2ee968e0 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae&tenant_id=8d7c8a074d704613bf45e1c8d95834e9 HTTP/1.1" status: 200 len: 1096 time: 0.0413826 Nov 15 17:55:15.632550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60726) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:15.643384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ca73dd-c933-49f5-9194-c45af432a368 req-775a1f46-d644-4305-a38f-17349b25d626 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:15.644915 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-775a1f46-d644-4305-a38f-17349b25d626 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1096 time: 0.0479035 Nov 15 17:55:15.745927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0197644-d4a4-4a98-a8aa-15d3b37a8e34 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:15.754504 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ca73dd-c933-49f5-9194-c45af432a368 req-e8152d0b-7eaa-4e7a-baec-36d26cb2a375 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:15.755968 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-e8152d0b-7eaa-4e7a-baec-36d26cb2a375 service neutron] 10.222.0.48 "GET /v2.0/networks?id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 200 len: 918 time: 0.1042423 Nov 15 17:55:15.843956 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-1dac32c6-7059-44ab-967f-80da7543e764 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 200 len: 999 time: 0.0802708 Nov 15 17:55:15.914425 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0197644-d4a4-4a98-a8aa-15d3b37a8e34 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:15.918756 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ca73dd-c933-49f5-9194-c45af432a368 req-0a261425-2c9a-4ad9-b43a-36d01aacbcfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:15.920370 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-0a261425-2c9a-4ad9-b43a-36d01aacbcfc service neutron] 10.222.0.48 "GET /v2.0/subnets?id=82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 200 len: 856 time: 0.0688920 Nov 15 17:55:15.921395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0197644-d4a4-4a98-a8aa-15d3b37a8e34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:15.954106 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9937196e-c468-4682-90e1-2f9cd51ee5b5 req-f8789739-ed48-47aa-be8f-543bf6b0c72e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:15.955632 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9937196e-c468-4682-90e1-2f9cd51ee5b5 req-f8789739-ed48-47aa-be8f-543bf6b0c72e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0491080 Nov 15 17:55:15.982035 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0197644-d4a4-4a98-a8aa-15d3b37a8e34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e531cc1-cc25-4755-89ff-b416230c3a6c,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:15.989797 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b0197644-d4a4-4a98-a8aa-15d3b37a8e34 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6a8020fb58004db184749de7312d1218&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3537858 Nov 15 17:55:15.991063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60732) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:16.001430 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ca73dd-c933-49f5-9194-c45af432a368 req-1ce0c61c-6883-4c92-85ca-a15eeb9f8b5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:16.002970 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-1ce0c61c-6883-4c92-85ca-a15eeb9f8b5e service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=927b3da0-f3f2-41e8-b00d-4ab5e71093d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0715821 Nov 15 17:55:16.018861 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9937196e-c468-4682-90e1-2f9cd51ee5b5 req-23fb5a54-f799-4b09-92ce-b55ce666c031 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571842 Nov 15 17:55:16.053297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.073953 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.099042 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-ac33a88b-979a-46e7-9880-7179881e1f2b service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886178 Nov 15 17:55:16.125314 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.127946 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.129068 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9e531cc1-cc25-4755-89ff-b416230c3a6c HTTP/1.1" status: 204 len: 168 time: 0.1375086 Nov 15 17:55:16.138778 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2deb7a9-c7e7-4679-9e2a-7949042dd768 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e531cc1-cc25-4755-89ff-b416230c3a6c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:16.200898 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-77ca73dd-c933-49f5-9194-c45af432a368 req-636a2183-d2ce-460a-8f72-adf054c6cfd0 service neutron] 10.222.0.48 "GET /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0941973 Nov 15 17:55:16.441672 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60748) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:16.456841 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-69e66e77-87e1-4994-baf1-f5526c1a3c97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.542837 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-69e66e77-87e1-4994-baf1-f5526c1a3c97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.547010 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-69e66e77-87e1-4994-baf1-f5526c1a3c97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.839992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60760) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:16.853393 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-69e66e77-87e1-4994-baf1-f5526c1a3c97 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=5dc4ab99af50497ea34fa2a89a027861&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4103684 Nov 15 17:55:16.854440 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e66e77-87e1-4994-baf1-f5526c1a3c97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=156a3100-a3d6-44e4-a569-a5c96de7a2dc,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:16.898840 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.921399 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.973635 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.977870 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:16.979467 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/156a3100-a3d6-44e4-a569-a5c96de7a2dc HTTP/1.1" status: 204 len: 168 time: 0.1385558 Nov 15 17:55:16.988146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03009b51-ad4c-4bb3-b1d5-2603a6ee2fe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=156a3100-a3d6-44e4-a569-a5c96de7a2dc,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:17.163334 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b335f4-2a26-44fb-bba3-bc9cb3d8c336 req-d5a802fb-8c4d-4cb1-bd83-97328d3dd698 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:17.165369 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-23b335f4-2a26-44fb-bba3-bc9cb3d8c336 req-d5a802fb-8c4d-4cb1-bd83-97328d3dd698 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0605624 Nov 15 17:55:17.224357 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-23b335f4-2a26-44fb-bba3-bc9cb3d8c336 req-488bc768-e2e8-40c5-b9e7-b65d715c062f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517998 Nov 15 17:55:18.358582 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0133ce3-4af8-42e1-9f0a-fb63591ec3b9 req-44e8e52b-9e2e-4f8a-b83c-524c6f565085 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:18.360124 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0133ce3-4af8-42e1-9f0a-fb63591ec3b9 req-44e8e52b-9e2e-4f8a-b83c-524c6f565085 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0543749 Nov 15 17:55:18.427223 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0133ce3-4af8-42e1-9f0a-fb63591ec3b9 req-a52e0c2f-5d33-414d-a42b-fad217976ce7 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588624 Nov 15 17:55:19.201915 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60834) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:19.309696 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-861cb762-455e-471e-a917-50baf19dde55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.387428 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-861cb762-455e-471e-a917-50baf19dde55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.392464 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-861cb762-455e-471e-a917-50baf19dde55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.433122 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-861cb762-455e-471e-a917-50baf19dde55 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=93931404567d40bda89784febdace52d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2300553 Nov 15 17:55:19.433597 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60840) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:19.434244 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861cb762-455e-471e-a917-50baf19dde55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39562d43-588a-452d-8fc4-f28f6b564de1,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:19.519949 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.544922 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.579850 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9082de61-0308-4e51-9023-c8053a9553a1 req-30efa0cd-b6c8-4db0-b05b-2e710ca21b62 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:19.582432 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9082de61-0308-4e51-9023-c8053a9553a1 req-30efa0cd-b6c8-4db0-b05b-2e710ca21b62 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0545578 Nov 15 17:55:19.602133 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.605257 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:19.610904 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/39562d43-588a-452d-8fc4-f28f6b564de1 HTTP/1.1" status: 204 len: 168 time: 0.1751661 Nov 15 17:55:19.621816 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b3fa84-285b-40f9-8cab-ee64c12e4393 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39562d43-588a-452d-8fc4-f28f6b564de1,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:19.648323 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9082de61-0308-4e51-9023-c8053a9553a1 req-f6ae444f-cde3-41b1-b930-eaa7bc6e5212 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594099 Nov 15 17:55:19.965945 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60848) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:19.980424 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43730c5f-62d2-4b3c-b10b-dd61ca66e2ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.061977 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43730c5f-62d2-4b3c-b10b-dd61ca66e2ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.066406 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-43730c5f-62d2-4b3c-b10b-dd61ca66e2ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.100704 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43730c5f-62d2-4b3c-b10b-dd61ca66e2ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=567bef98-4007-409e-b899-5aa1dbce1376,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:20.116480 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-43730c5f-62d2-4b3c-b10b-dd61ca66e2ea admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a402d79b09044b24a1e08b98932806f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1494331 Nov 15 17:55:20.117933 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 60850) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:20.169488 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.192511 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.241477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.244106 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:20.245266 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/567bef98-4007-409e-b899-5aa1dbce1376 HTTP/1.1" status: 204 len: 168 time: 0.1263988 Nov 15 17:55:20.257942 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08007658-8de7-4120-9249-b8fe70df4437 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=567bef98-4007-409e-b899-5aa1dbce1376,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:20.800984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ec2276-8346-4631-9ca5-eb0808eaaf5b req-7d9d2510-f6eb-4c76-8639-3574923e9bda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:20.802538 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f4ec2276-8346-4631-9ca5-eb0808eaaf5b req-7d9d2510-f6eb-4c76-8639-3574923e9bda tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0545807 Nov 15 17:55:20.854504 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f4ec2276-8346-4631-9ca5-eb0808eaaf5b req-7df8d0a9-72ae-4a70-a6fc-bf355ea9775a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452754 Nov 15 17:55:21.382883 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60882) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:21.492351 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5a5c7248-a003-4bc0-aefc-0a5400a87dbe admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.574269 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5a5c7248-a003-4bc0-aefc-0a5400a87dbe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.579526 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5a5c7248-a003-4bc0-aefc-0a5400a87dbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.619671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5c7248-a003-4bc0-aefc-0a5400a87dbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cedab39e-32be-41a8-9808-fab84af07ebe,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:21.627274 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5a5c7248-a003-4bc0-aefc-0a5400a87dbe admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=79efc48c1d3744fa83be372c8f4fd7c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2403045 Nov 15 17:55:21.627753 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 60886) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:21.684060 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.710324 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.764354 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.770402 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:21.773917 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cedab39e-32be-41a8-9808-fab84af07ebe HTTP/1.1" status: 204 len: 168 time: 0.1432159 Nov 15 17:55:21.780903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-366f628f-24b2-4460-b387-ef55b4a238e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cedab39e-32be-41a8-9808-fab84af07ebe,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:21.995897 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d136ee6-fae4-4262-be44-d2f7321e553e req-c9d5a543-652e-4142-91d5-d02fa14cb139 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:22.004494 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d136ee6-fae4-4262-be44-d2f7321e553e req-c9d5a543-652e-4142-91d5-d02fa14cb139 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0629406 Nov 15 17:55:22.053440 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d136ee6-fae4-4262-be44-d2f7321e553e req-85d500dc-4a86-499d-9af8-5b5aa137d106 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473728 Nov 15 17:55:22.371376 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:23.204965 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a716cdd-75b3-4d9f-b041-a1d0af5049ce req-a768b244-5988-46f5-97f2-edffbf2624d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:23.206710 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4a716cdd-75b3-4d9f-b041-a1d0af5049ce req-a768b244-5988-46f5-97f2-edffbf2624d3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0553362 Nov 15 17:55:23.260331 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4a716cdd-75b3-4d9f-b041-a1d0af5049ce req-f11aaa77-d5bc-4142-8e5c-415db16bda11 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465994 Nov 15 17:55:24.060123 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-c5bb7881-bd35-4a86-acf3-23132e6d14db tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=69f691868a8c485384fb1495d4e1e832&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0312285 Nov 15 17:55:24.251819 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-867113e9-69c4-4583-9569-b8d55fdd657d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:24.253294 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-867113e9-69c4-4583-9569-b8d55fdd657d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1872628 Nov 15 17:55:24.268958 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-c6740130-4889-44ac-aa4e-1bc2f3ed4396 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/quotas/69f691868a8c485384fb1495d4e1e832 HTTP/1.1" status: 200 len: 375 time: 0.0099413 Nov 15 17:55:24.308055 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-da115d74-284d-44fa-ac5a-ad04991cbfae tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=69f691868a8c485384fb1495d4e1e832&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0322425 Nov 15 17:55:24.404662 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26dc840f-0c29-4ed7-8940-25ea876131a9 req-9746f306-748f-4a6d-a0a3-d8297354c1de tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:24.406513 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-26dc840f-0c29-4ed7-8940-25ea876131a9 req-9746f306-748f-4a6d-a0a3-d8297354c1de tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0551257 Nov 15 17:55:24.467290 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-26dc840f-0c29-4ed7-8940-25ea876131a9 req-a69374ff-f7e2-40df-ad68-0a073f07f07e tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550051 Nov 15 17:55:24.514438 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fca3088a-967d-4de6-8d17-cfa22859feb8 req-33048526-83b8-41f6-9e2a-53d4bdc3c4c4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 210 time: 0.0417945 Nov 15 17:55:25.613840 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0454775a-9d24-4018-9bc4-8a297e611d4a req-53ee3563-4f04-4bb5-b802-b648cb638941 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:25.616670 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0454775a-9d24-4018-9bc4-8a297e611d4a req-53ee3563-4f04-4bb5-b802-b648cb638941 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0713508 Nov 15 17:55:25.649593 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2038857c-3ab1-4fe9-950e-ef78e85a5556 req-2c81099f-efaf-438d-9919-0b6058ca558b tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 210 time: 0.0315478 Nov 15 17:55:25.689258 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0454775a-9d24-4018-9bc4-8a297e611d4a req-763adb50-3c3d-43b1-8f41-21931ced803b tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0625958 Nov 15 17:55:26.753199 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-99a55d09-be6f-416d-a0d4-d129b55e3566 req-2c622ed6-e250-4603-bc70-6e267dd572bd tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 210 time: 0.0261772 Nov 15 17:55:26.814872 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206a533c-1059-4e30-b45b-fabfb8cee0cf req-6591cba0-ceb6-4c21-a137-c1f4d0e070cc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:26.816363 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-206a533c-1059-4e30-b45b-fabfb8cee0cf req-6591cba0-ceb6-4c21-a137-c1f4d0e070cc tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0532773 Nov 15 17:55:26.877588 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-206a533c-1059-4e30-b45b-fabfb8cee0cf req-edf366e1-c56c-4e76-8e02-beb2919fe7c5 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521371 Nov 15 17:55:26.918258 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-d82875f8-9597-419b-b57b-0591ad90d655 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0455949 Nov 15 17:55:27.007028 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-fafe4bb8-1ea4-4532-b702-0683838fbed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:27.008736 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-fafe4bb8-1ea4-4532-b702-0683838fbed4 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 1098 time: 0.0410419 Nov 15 17:55:27.115158 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-b481e5b3-3160-401d-85bb-849dbadf6617 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:27.117021 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-b481e5b3-3160-401d-85bb-849dbadf6617 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0869699 Nov 15 17:55:27.185159 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-7cddade7-5471-4103-9c08-80abf3e45fb0 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 200 len: 1001 time: 0.0601432 Nov 15 17:55:27.237269 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-1184b8ec-07db-46dd-93e5-4348a2a95861 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:27.238668 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-1184b8ec-07db-46dd-93e5-4348a2a95861 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0420790 Nov 15 17:55:27.289440 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-16b2cf3a-7306-4099-b96d-8f32324becdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:27.290892 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-16b2cf3a-7306-4099-b96d-8f32324becdd service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439205 Nov 15 17:55:27.414574 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-222fd0dd-461b-43c6-854d-2a5ab78d3386 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1129224 Nov 15 17:55:27.416237 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-7b0fea01-0906-4c58-a4f8-6320e0228184 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.48 "GET /v2.0/networks?tenant_id=69f691868a8c485384fb1495d4e1e832&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0360425 Nov 15 17:55:27.657992 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e9d2df18-7bce-4ae2-95f1-ff7a5ab0c10a req-fb7221d1-ffd8-47ed-95c6-2245f0b2c169 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2313161 Nov 15 17:55:27.666865 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-e3f7dec3-3a7e-4678-9aeb-f9409a1e07ec tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:27.668337 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-e3f7dec3-3a7e-4678-9aeb-f9409a1e07ec tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2406392 Nov 15 17:55:27.684099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Request body: {'port': {'device_id': '00950928-ae13-4173-93e6-e9a1ccab625a', 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42', 'admin_state_up': True, 'tenant_id': '69f691868a8c485384fb1495d4e1e832'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:27.802947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Made reservation on behalf of 69f691868a8c485384fb1495d4e1e832 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:27.806743 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:27.815665 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:27.849959 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-003dffa9-740b-4661-ad46-9f342f2c71f9 req-93040e1a-b0a2-4f91-81dc-c31697f35cfb tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 210 time: 0.0273864 Nov 15 17:55:27.891859 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:27.896952 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:27.957722 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Pushing event updated for resources: {'SecurityGroup': ['ID=507605d6-1dbf-4ee1-8930-bec084b2bac9,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:28.010787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95b88bf0-4fbe-4da2-a3ae-1dfe1d0ccd09 req-886a807c-7f10-4840-8b2a-5caf02cd149a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:28.012350 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-95b88bf0-4fbe-4da2-a3ae-1dfe1d0ccd09 req-886a807c-7f10-4840-8b2a-5caf02cd149a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0612633 Nov 15 17:55:28.039294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Allocated IP 192.168.233.189 (54e84c9d-4ab3-44fd-a688-9b14f9d90f42/59fc9c38-3053-45b9-8ec0-f51e391e8e28/e95f6aac-f26e-4d96-9a39-b1c24e67d3e2) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:28.063399 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-95b88bf0-4fbe-4da2-a3ae-1dfe1d0ccd09 req-5fce42ef-74d3-4ead-8c0f-e043b66fd8c2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441520 Nov 15 17:55:28.192134 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.229590 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.277157 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:28.282454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:28.286682 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:28.290573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Pushing event updated for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:28.336425 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:28.337036 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.353662 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-f206fc59-eeb5-48a1-b731-21ab82ca65e4 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6755302 Nov 15 17:55:28.366618 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Request body: {'port': {'device_id': '00950928-ae13-4173-93e6-e9a1ccab625a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:28.419804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.495860 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-41f76acc-df7b-4f4a-8865-cc36307f589a None None] Provisioning complete for port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:28.496542 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-41f76acc-df7b-4f4a-8865-cc36307f589a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.531385 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-41f76acc-df7b-4f4a-8865-cc36307f589a None None] Port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:28.681372 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:28.689311 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.705877 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Transition to ACTIVE for port object e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:55:28.711872 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.768254 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Pushing event updated for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:28.845255 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Attempting to bind port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:28.845757 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Attempting to bind port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:28.846113 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Attempting to bind port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 on network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:28.851225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 on network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:55:28.851546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Attempting to bind port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 on network 54e84c9d-4ab3-44fd-a688-9b14f9d90f42 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:28.857016 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:28.857348 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Checking segment: {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:28.857727 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Bound using segment: {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:28.858153 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Bound port: e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'adea3c81-84f8-4338-a68e-9347d5ee6eec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:28.858503 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.926619 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:28.929809 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:28.934348 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.967318 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:28.968010 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:28.969509 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] 10.222.0.48 "PUT /v2.0/ports/e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 HTTP/1.1" status: 200 len: 1098 time: 0.6074455 Nov 15 17:55:28.969958 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:28.972420 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea" -d '{"events": [{"name": "network-changed", "server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:28.973581 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dffc742-e6e0-4ec5-ad08-ba7a254f7ac5 req-26044487-2c9e-41f8-9c7d-4d15d1af8f15 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:28.975121 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4dffc742-e6e0-4ec5-ad08-ba7a254f7ac5 req-26044487-2c9e-41f8-9c7d-4d15d1af8f15 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 948 time: 0.0492771 Nov 15 17:55:29.009371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde2bb77-395b-43c8-80a0-3f39fae98225 service neutron] Pushing event updated for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:29.029860 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17c63d57-00a3-4985-87d9-b3410a0923f2 x-openstack-request-id: req-17c63d57-00a3-4985-87d9-b3410a0923f2 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:29.030150 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:29.030405 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-17c63d57-00a3-4985-87d9-b3410a0923f2 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:29.030803 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2', 'status': 'completed', 'code': 200} Nov 15 17:55:29.040289 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4dffc742-e6e0-4ec5-ad08-ba7a254f7ac5 req-fc52ed48-8460-4ad4-8fd5-91e41f2a2171 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591450 Nov 15 17:55:29.061453 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-6c2c011d-38b8-4b3a-9e68-aa5b9053fe39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.062967 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-6c2c011d-38b8-4b3a-9e68-aa5b9053fe39 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=69f691868a8c485384fb1495d4e1e832&device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 1101 time: 0.0459566 Nov 15 17:55:29.108813 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-898b6f49-888a-41ec-992e-7ff07675e2e7 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.189&port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 HTTP/1.1" status: 200 len: 217 time: 0.0377834 Nov 15 17:55:29.161933 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-02c9b157-4a17-48cb-bce3-6184724dae00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.163491 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-02c9b157-4a17-48cb-bce3-6184724dae00 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=59fc9c38-3053-45b9-8ec0-f51e391e8e28 HTTP/1.1" status: 200 len: 843 time: 0.0478663 Nov 15 17:55:29.188235 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f78d6c3-9dd8-4284-87ae-0e2c4efc95f2 req-bb508ae8-5285-4b6a-bd34-a67af617595f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.190111 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f78d6c3-9dd8-4284-87ae-0e2c4efc95f2 req-bb508ae8-5285-4b6a-bd34-a67af617595f tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 943 time: 0.0498171 Nov 15 17:55:29.208486 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-fb7c9ee5-30f8-467b-adeb-bd07a7f26164 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.209986 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-fb7c9ee5-30f8-467b-adeb-bd07a7f26164 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=54e84c9d-4ab3-44fd-a688-9b14f9d90f42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0385671 Nov 15 17:55:29.236872 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f78d6c3-9dd8-4284-87ae-0e2c4efc95f2 req-c39f45f1-8449-41c9-a579-290234c54784 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408125 Nov 15 17:55:29.304640 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-18abfe85-9699-4a96-b8b3-0b0eb60ace6c service neutron] 10.222.0.48 "GET /v2.0/networks/54e84c9d-4ab3-44fd-a688-9b14f9d90f42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868971 Nov 15 17:55:29.375476 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:55:29.398169 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-e39c5f82-2a3b-4e97-8621-8543a4197a12 req-30f5891f-cb31-4d34-a83f-51f7506c47c5 service neutron] 10.222.0.48 "GET /v2.0/networks/54e84c9d-4ab3-44fd-a688-9b14f9d90f42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856814 Nov 15 17:55:29.471931 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:29.487842 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'port_id': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'mac_address': 'fa:16:3e:d8:39:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 447, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:55:29.490233 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-6f4e485b-6836-469d-90b3-a5e32dc7aa73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.492260 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-6f4e485b-6836-469d-90b3-a5e32dc7aa73 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=69f691868a8c485384fb1495d4e1e832&device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 1101 time: 0.0435970 Nov 15 17:55:29.524758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:29.537805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:29.556819 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:29.561404 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:29.583927 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-9b8f7ef1-0f6b-4d58-9442-17c252d86597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.585361 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-9b8f7ef1-0f6b-4d58-9442-17c252d86597 service neutron] 10.222.0.48 "GET /v2.0/networks?id=54e84c9d-4ab3-44fd-a688-9b14f9d90f42 HTTP/1.1" status: 200 len: 870 time: 0.0865216 Nov 15 17:55:29.609285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=9']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:29.630577 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-8ba63efe-8ca8-435b-b5d6-328e59d5f400 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.189&port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 HTTP/1.1" status: 200 len: 217 time: 0.0367527 Nov 15 17:55:29.680345 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-d3a0bd80-c20f-48d9-9530-0e66e2ce68bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.681785 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-d3a0bd80-c20f-48d9-9530-0e66e2ce68bc service neutron] 10.222.0.48 "GET /v2.0/subnets?id=59fc9c38-3053-45b9-8ec0-f51e391e8e28 HTTP/1.1" status: 200 len: 843 time: 0.0434053 Nov 15 17:55:29.735453 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-2f2a124b-482a-404e-944c-c05a0d502766 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:29.736965 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-2f2a124b-482a-404e-944c-c05a0d502766 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=54e84c9d-4ab3-44fd-a688-9b14f9d90f42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0470946 Nov 15 17:55:29.795897 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:55:29.834000 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-1abb5e40-85b3-448a-857d-92b16454b59b service neutron] 10.222.0.48 "GET /v2.0/networks/54e84c9d-4ab3-44fd-a688-9b14f9d90f42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883710 Nov 15 17:55:29.925969 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8351f65a-d01b-45ed-9dbc-913eca2cc2ea req-cc2d0fa4-803d-4ae4-b501-f6ba591114a7 service neutron] 10.222.0.48 "GET /v2.0/networks/54e84c9d-4ab3-44fd-a688-9b14f9d90f42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832770 Nov 15 17:55:30.162064 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-036048d2-7f7f-4aab-887a-4457c112a755 req-bec0e752-3954-4b9e-aae2-b429f8555bfd tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:30.163506 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-036048d2-7f7f-4aab-887a-4457c112a755 req-bec0e752-3954-4b9e-aae2-b429f8555bfd tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 948 time: 0.0503840 Nov 15 17:55:30.212423 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-036048d2-7f7f-4aab-887a-4457c112a755 req-08abefaa-dd14-4bb4-88dd-1ae3a8d501dd tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429020 Nov 15 17:55:30.361196 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc04a3bf-a8f0-4819-93e7-e7efeaf302c4 req-c9692703-b7a8-4771-afdd-95b53b394ee1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:30.362565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bc04a3bf-a8f0-4819-93e7-e7efeaf302c4 req-c9692703-b7a8-4771-afdd-95b53b394ee1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0528295 Nov 15 17:55:30.412464 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bc04a3bf-a8f0-4819-93e7-e7efeaf302c4 req-099bb0bb-af82-4039-a6d5-ba0c33c3e490 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434670 Nov 15 17:55:30.786402 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e8ffd6c5-d8d0-4b6b-ad32-03087a80a2d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:30.822691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e14e6a0-79c2-4578-a3b9-7c63dfcb1482 req-463762ba-2c90-401c-96e0-f2ea7db9d365 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:30.824192 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e14e6a0-79c2-4578-a3b9-7c63dfcb1482 req-463762ba-2c90-401c-96e0-f2ea7db9d365 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0525167 Nov 15 17:55:30.876570 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8e14e6a0-79c2-4578-a3b9-7c63dfcb1482 req-daf5af80-7605-4f72-ad8a-d65f376461f4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442200 Nov 15 17:55:31.063082 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:55:31.350218 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079d200b-2f46-406a-8d06-e77a70feb83d req-7743ec83-64d5-44dc-b46b-5eb3d6df4022 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:31.351679 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-079d200b-2f46-406a-8d06-e77a70feb83d req-7743ec83-64d5-44dc-b46b-5eb3d6df4022 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 948 time: 0.0553746 Nov 15 17:55:31.378448 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:31.405884 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-079d200b-2f46-406a-8d06-e77a70feb83d req-cb318849-905d-4395-b966-1a2d448ad90a tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451462 Nov 15 17:55:31.428909 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:31.429274 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:31.510644 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:31.533441 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:31.535713 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4c4b378-ca23-4a16-a263-e1c513f26ec8" -d '{"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:31.541301 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbdc8b86-14f2-451d-aae2-197d2ef9b445 req-a923a96b-186f-4c2a-8e06-9500923c6f6a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:31.542786 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bbdc8b86-14f2-451d-aae2-197d2ef9b445 req-a923a96b-186f-4c2a-8e06-9500923c6f6a tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 944 time: 0.0481968 Nov 15 17:55:31.550332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:31.555053 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:31.577903 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f070121-5b5f-4ccc-ab3e-72ea42b26ac5 x-openstack-request-id: req-4f070121-5b5f-4ccc-ab3e-72ea42b26ac5 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:31.578186 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-plugged", "status": "completed", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:31.578431 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4f070121-5b5f-4ccc-ab3e-72ea42b26ac5 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:31.578805 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'code': 200} Nov 15 17:55:31.591238 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-bbdc8b86-14f2-451d-aae2-197d2ef9b445 req-fc8ce7b0-9e42-416d-8d4d-2acd70a0fcf3 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417905 Nov 15 17:55:31.607407 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=10']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:31.759549 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3239097e-b7ad-42dd-af48-911291063b1d req-fed9c5cf-42aa-47c2-beee-d6a7e8c24a3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:31.760983 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3239097e-b7ad-42dd-af48-911291063b1d req-fed9c5cf-42aa-47c2-beee-d6a7e8c24a3a service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 1099 time: 0.0414901 Nov 15 17:55:31.812103 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-3239097e-b7ad-42dd-af48-911291063b1d req-39517022-6e05-43de-88c6-43241fb96695 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421970 Nov 15 17:55:32.003547 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ff9a5f-3494-4edb-92b8-c3a38ac2b77d req-e9156d07-2c21-4acd-985d-de0ee3db5fa6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:32.005158 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-26ff9a5f-3494-4edb-92b8-c3a38ac2b77d req-e9156d07-2c21-4acd-985d-de0ee3db5fa6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0584273 Nov 15 17:55:32.056700 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-26ff9a5f-3494-4edb-92b8-c3a38ac2b77d req-42617d70-cc3b-4fa9-a8c3-e1941864f2e4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455525 Nov 15 17:55:32.492680 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568eadba-aac7-4149-ad77-53f856a936b5 req-3d24a5be-72d3-4a91-95a0-921d6ee61555 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:32.494123 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-568eadba-aac7-4149-ad77-53f856a936b5 req-3d24a5be-72d3-4a91-95a0-921d6ee61555 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 945 time: 0.0544620 Nov 15 17:55:32.538110 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e7ccc8-04e4-47f8-9932-c7a74d3e08b4 req-b35572d6-6ca8-4fa4-b9e6-0ac247a7121c tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:32.539626 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-47e7ccc8-04e4-47f8-9932-c7a74d3e08b4 req-b35572d6-6ca8-4fa4-b9e6-0ac247a7121c tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 948 time: 0.0529339 Nov 15 17:55:32.585620 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:32.585952 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:32.587730 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-47e7ccc8-04e4-47f8-9932-c7a74d3e08b4 req-c4559cfd-bd61-4be1-b8ec-1e3658e983de tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420656 Nov 15 17:55:32.684025 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] For port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:32.684387 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:32.723867 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385e3677-d15d-49fc-80ec-323d10146717 req-e5d4088d-d16e-4f5d-8b0f-1327b31d73b0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:32.725522 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-385e3677-d15d-49fc-80ec-323d10146717 req-e5d4088d-d16e-4f5d-8b0f-1327b31d73b0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 946 time: 0.0499859 Nov 15 17:55:32.776331 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-385e3677-d15d-49fc-80ec-323d10146717 req-0ea7382f-5f63-456b-b706-33106f1e2e31 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434589 Nov 15 17:55:32.851761 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:32.852464 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:32.852464 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 9555c4a5-a365-45f2-8502-dc3118e496a2 disassociated. External IP: 172.27.0.206, port: b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25. Nov 15 17:55:32.852854 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:32.981797 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:33.009905 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:33.098799 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a16d16ea-0475-4aa7-9ad0-217d0a25c62c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:33.124969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:55:33.168472 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c1d7a33e-d596-48ce-85a8-143237391f47 req-0f256600-e6eb-4a9b-ab06-fed050a2127b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5 HTTP/1.1" status: 200 len: 210 time: 0.0265779 Nov 15 17:55:33.236122 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:33.246439 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:33.262387 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:33.262862 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:33.275367 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] No DVR routers for this DVR port b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:55:33.279016 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:33.282388 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-568eadba-aac7-4149-ad77-53f856a936b5 req-0641a082-2856-44cc-b1fe-67493e938d61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "DELETE /v2.0/ports/b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 HTTP/1.1" status: 204 len: 173 time: 0.7812228 Nov 15 17:55:33.282858 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'name': 'network-vif-deleted', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:33.285709 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d28b1b8a-8e45-4756-98fc-fdd495334d08" -d '{"events": [{"server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "name": "network-vif-deleted", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:33.327126 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb2b8e2c-3bc2-496d-aad4-2760827df5bc x-openstack-request-id: req-bb2b8e2c-3bc2-496d-aad4-2760827df5bc {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:33.327621 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5", "name": "network-vif-deleted", "tag": "b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:33.328101 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-bb2b8e2c-3bc2-496d-aad4-2760827df5bc {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:33.328710 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf36c8c3-fc57-49ec-9dcd-b0098a9d0ba5', 'name': 'network-vif-deleted', 'tag': 'b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25', 'status': 'completed', 'code': 200} Nov 15 17:55:33.368880 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:55:33.425292 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:33.476728 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:33.491106 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2', 'network_id': '54e84c9d-4ab3-44fd-a688-9b14f9d90f42', 'port_id': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2', 'mac_address': 'fa:16:3e:9c:76:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 403, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59fc9c38-3053-45b9-8ec0-f51e391e8e28', 'ip_address': '192.168.233.189'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:55:33.535844 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:33.550136 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:33.577642 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:33.582568 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:33.640946 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:33.672330 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:33.703976 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:33.712897 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:33.713598 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:33.741156 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a9b140-bbd8-414d-83d0-06f3eab7223e req-2ad299e3-cf14-40d8-93fd-1d3aa64a5ab3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:33.742804 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-04a9b140-bbd8-414d-83d0-06f3eab7223e req-2ad299e3-cf14-40d8-93fd-1d3aa64a5ab3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 949 time: 0.0625508 Nov 15 17:55:33.793883 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-04a9b140-bbd8-414d-83d0-06f3eab7223e req-cf73bb2f-6437-499b-86f8-98c9fd56c449 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445335 Nov 15 17:55:33.795356 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['e95f6aac-f26e-4d96-9a39-b1c24e67d3e2'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:55:33.913261 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:33.919510 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe69c7fd-d7c6-46b2-9f09-cd763fe3aa99 req-bb2f9c95-15a4-445f-80ba-4855d9313247 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:33.921118 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fe69c7fd-d7c6-46b2-9f09-cd763fe3aa99 req-bb2f9c95-15a4-445f-80ba-4855d9313247 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 946 time: 0.0516608 Nov 15 17:55:33.980828 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fe69c7fd-d7c6-46b2-9f09-cd763fe3aa99 req-6f7753ee-1e73-4ceb-89c1-0a3863c82285 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510817 Nov 15 17:55:34.129394 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:34.158327 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1da14497-a0a5-40a6-9d5c-905cf61a9cd2 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:34.384589 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85778726-8a21-4155-af9e-46848be86ba5 None None] New status for floating IP 9555c4a5-a365-45f2-8502-dc3118e496a2: DOWN {{(pid=108143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:55:34.440499 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-ec21dd7c-7a9e-42a0-ac5f-b395453261a9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1950932927&fields=id&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 267 time: 0.0472834 Nov 15 17:55:34.552211 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-835c2975-a142-43ba-a918-44d4c27bcf77 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:34.552849 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-835c2975-a142-43ba-a918-44d4c27bcf77 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1050191 Nov 15 17:55:34.567930 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-e9227142-d713-4008-9525-3c5b8b3239e3 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/quotas/02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 375 time: 0.0092745 Nov 15 17:55:34.593151 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:34.620378 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-86d5df69-22e3-488f-aaa4-b30a771041bb tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0470638 Nov 15 17:55:34.720087 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-e1d93dd8-2422-402e-bf0b-35343cf18bf5 service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860131 Nov 15 17:55:34.811239 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-78a1c889-0cec-4c66-9936-47a34a373cc8 service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843244 Nov 15 17:55:34.911848 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fa7992-f002-4ac1-9390-7199e1ed3edb req-b7831cc0-8b28-4814-9e68-3a250fa3618d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:34.913416 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59fa7992-f002-4ac1-9390-7199e1ed3edb req-b7831cc0-8b28-4814-9e68-3a250fa3618d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 949 time: 0.0492158 Nov 15 17:55:34.962126 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-59fa7992-f002-4ac1-9390-7199e1ed3edb req-f626f8b0-9128-4fd5-8ac1-e55405e42a18 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427468 Nov 15 17:55:35.089780 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8b843f8a-f232-48d7-a375-10d5b2eac6e2 req-9d4a8059-88d2-40a5-aa64-c65a3da6dc88 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 210 time: 0.0261419 Nov 15 17:55:35.380448 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:35.432003 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:55:35.435899 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:35.436265 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:35.517943 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:35.540459 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:35.542679 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a43af70c-317d-4d36-94bd-eddb166613a3" -d '{"events": [{"server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "name": "network-vif-plugged", "status": "completed", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:35.555532 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:35.559478 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:35.560434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:35.599516 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19a28929-c0d8-48d8-a035-9174734fa047 x-openstack-request-id: req-19a28929-c0d8-48d8-a035-9174734fa047 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:35.599810 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "name": "network-vif-plugged", "status": "completed", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:35.600116 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-19a28929-c0d8-48d8-a035-9174734fa047 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:35.601024 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2', 'code': 200} Nov 15 17:55:35.611655 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:35.612078 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device b93cabe3-6f86-42f9-bbdc-2e0a30d6ea25 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:35.623467 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:35.641915 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:36.058324 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae451ad-2b61-4eb5-92ce-cf31ee8caa38 req-b4f451c6-7b35-44f5-9113-667570503b39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:36.059842 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4ae451ad-2b61-4eb5-92ce-cf31ee8caa38 req-b4f451c6-7b35-44f5-9113-667570503b39 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 1103 time: 0.3422134 Nov 15 17:55:36.085229 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704acc72-bb70-4242-bcc8-141c1b3e7f2d req-d988ae9a-ba5a-4039-9bdc-ca8a72dcaee3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:36.086795 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-704acc72-bb70-4242-bcc8-141c1b3e7f2d req-d988ae9a-ba5a-4039-9bdc-ca8a72dcaee3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0510225 Nov 15 17:55:36.146029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-4460dd4c-5b00-4126-a40b-fc1c86b6ccf9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:36.147588 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-4460dd4c-5b00-4126-a40b-fc1c86b6ccf9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1413958 Nov 15 17:55:36.149741 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-4ae451ad-2b61-4eb5-92ce-cf31ee8caa38 req-432a06e3-ac20-44c1-8b37-d54d984bf39f service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785401 Nov 15 17:55:36.152224 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-704acc72-bb70-4242-bcc8-141c1b3e7f2d req-9f73a469-a2f8-44c3-a248-d821722f0be9 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587349 Nov 15 17:55:36.195983 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b0115a84-76a3-430b-b35c-717c9a471200 req-371ed92e-d53e-4ae0-886e-a836db3c4029 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 210 time: 0.0259535 Nov 15 17:55:36.410579 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-6b8dacd5-bd4f-4944-8eb6-2733c6bb06bc tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 380 time: 0.0576513 Nov 15 17:55:36.425911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'port': {'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'admin_state_up': True, 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'security_groups': ['d1957e86-4d23-410d-832b-14bd8f646ece']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:36.535139 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Made reservation on behalf of 02ec9c6dcc7d48c5b52b4ee146d42ec8 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:36.538631 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:36.665826 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:36.676166 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.20.0.13 (225bbc0e-9530-4b54-be05-d3092f2f1bf3/4800e8bb-9314-46c0-b919-995a65894f5c/f5758317-a1ce-4645-bc74-a6fda94fcfb1) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:36.819474 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:36.858657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:36.903416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:36.906819 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:36.911200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:36.915139 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:36.960920 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:36.961539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:36.978620 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-1ff2b263-2de2-4bcc-97c6-a38d94a05253 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5566144 Nov 15 17:55:36.991953 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Request body: {'port': {'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:37.049371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.161361 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-6f116636-dc6c-49e4-8222-4f9de161d1ec None None] Provisioning complete for port f5758317-a1ce-4645-bc74-a6fda94fcfb1 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:37.161695 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6f116636-dc6c-49e4-8222-4f9de161d1ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.196489 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-6f116636-dc6c-49e4-8222-4f9de161d1ec None None] Port f5758317-a1ce-4645-bc74-a6fda94fcfb1 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:37.307888 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f19bc-20ba-48fc-845b-facedb0175a4 req-a8b747ff-5a20-4e53-aebf-4a91bf6577e3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.309370 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2e6f19bc-20ba-48fc-845b-facedb0175a4 req-a8b747ff-5a20-4e53-aebf-4a91bf6577e3 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0809741 Nov 15 17:55:37.326824 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f5758317-a1ce-4645-bc74-a6fda94fcfb1 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:37.331645 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421e3bce-ed7c-4e58-a55d-1986076def33 req-b028146d-c3b3-4666-b5b6-61745f4241fd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.333116 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-421e3bce-ed7c-4e58-a55d-1986076def33 req-b028146d-c3b3-4666-b5b6-61745f4241fd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 932 time: 0.0682001 Nov 15 17:55:37.334590 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.347682 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Transition to ACTIVE for port object f5758317-a1ce-4645-bc74-a6fda94fcfb1 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:55:37.351579 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.407825 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2e6f19bc-20ba-48fc-845b-facedb0175a4 req-028f91b5-f72f-4e47-b5c0-d304d34dc93f tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893590 Nov 15 17:55:37.409504 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Pushing event updated for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:37.414620 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-421e3bce-ed7c-4e58-a55d-1986076def33 req-4fa8b545-d0e8-4970-a5d7-577f4d184527 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741050 Nov 15 17:55:37.480788 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Attempting to bind port f5758317-a1ce-4645-bc74-a6fda94fcfb1 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:37.481294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Attempting to bind port f5758317-a1ce-4645-bc74-a6fda94fcfb1 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:37.482050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Attempting to bind port f5758317-a1ce-4645-bc74-a6fda94fcfb1 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:37.486539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Port f5758317-a1ce-4645-bc74-a6fda94fcfb1 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:55:37.486882 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Attempting to bind port f5758317-a1ce-4645-bc74-a6fda94fcfb1 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:37.492542 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:37.492874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:37.493253 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Bound using segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:37.493676 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Bound port: f5758317-a1ce-4645-bc74-a6fda94fcfb1, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:37.494025 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.559164 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:37.562321 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:37.568072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.605417 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.606034 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:37.607413 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] 10.222.0.48 "PUT /v2.0/ports/f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 1094 time: 0.6202354 Nov 15 17:55:37.607911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:37.610172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6" -d '{"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:37.633139 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa614f62-0319-492f-ac71-b1876c8b34be service neutron] Pushing event updated for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:37.694217 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9612cda3-0460-4537-9311-021dbbbd38a6 x-openstack-request-id: req-9612cda3-0460-4537-9311-021dbbbd38a6 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:37.694496 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:37.694804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9612cda3-0460-4537-9311-021dbbbd38a6 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:37.695247 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'status': 'completed', 'code': 200} Nov 15 17:55:37.712143 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-8d12dee7-32a2-4d34-a985-57d06be67f8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.714245 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-8d12dee7-32a2-4d34-a985-57d06be67f8d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1097 time: 0.0624871 Nov 15 17:55:37.759494 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-f96968a0-b2ce-4d0b-9479-b1cea438bd55 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 217 time: 0.0372174 Nov 15 17:55:37.809155 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-f4569504-db43-4f58-bfa7-2df851d4b708 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.810585 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-f4569504-db43-4f58-bfa7-2df851d4b708 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0431402 Nov 15 17:55:37.855374 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-757e9436-a3b6-4cb1-8c62-bb9529f6b420 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:37.856834 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-757e9436-a3b6-4cb1-8c62-bb9529f6b420 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0389237 Nov 15 17:55:37.950801 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-58512e96-9d7a-4328-937f-e0b62dbfee05 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852587 Nov 15 17:55:38.062719 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9b91c613-75f5-465d-aa99-5949a5d7e4f8 req-51a3e1d2-85db-4a87-992d-125145be67e3 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1040244 Nov 15 17:55:38.159852 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-4736db4f-1fca-4353-af5e-0c6e7d22cea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.161968 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-4736db4f-1fca-4353-af5e-0c6e7d22cea7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1097 time: 0.0478849 Nov 15 17:55:38.256856 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-b5647d10-64b8-4676-bc7f-fca6a75138ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.258295 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-b5647d10-64b8-4676-bc7f-fca6a75138ea service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0863099 Nov 15 17:55:38.305818 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-a2fb0381-86a9-47cd-a1ef-72e7589adb01 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 217 time: 0.0365181 Nov 15 17:55:38.359168 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-85f6abdd-23c4-480f-a1f6-697e7bc9bf95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.362506 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-85f6abdd-23c4-480f-a1f6-697e7bc9bf95 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0469487 Nov 15 17:55:38.413624 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-bd3768e4-818e-46e8-88ff-cd2341975840 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.415117 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-bd3768e4-818e-46e8-88ff-cd2341975840 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0473490 Nov 15 17:55:38.516833 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-526f3135-9f6a-4fab-826f-f363528b8a40 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922751 Nov 15 17:55:38.562052 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b6bc15-9c81-438d-a2a7-10cf9b6d2651 req-4ac1cc45-7576-4f69-a1b5-0022e0ef1aa7 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.563491 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10b6bc15-9c81-438d-a2a7-10cf9b6d2651 req-4ac1cc45-7576-4f69-a1b5-0022e0ef1aa7 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0750110 Nov 15 17:55:38.570811 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3264f683-c657-4592-bb2b-b817f275b9b6 req-7a67de12-b9f4-417a-94ae-790691c0ea90 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.572181 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3264f683-c657-4592-bb2b-b817f275b9b6 req-7a67de12-b9f4-417a-94ae-790691c0ea90 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0746713 Nov 15 17:55:38.608608 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0077eb06-57ce-480d-9ce3-1e97bd0b69a6 req-a86c771a-e5b3-4145-b4b7-a977a2f23fde service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834751 Nov 15 17:55:38.639863 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-10b6bc15-9c81-438d-a2a7-10cf9b6d2651 req-3d73efe8-aa25-4bd1-aad4-f075d5e3d331 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667064 Nov 15 17:55:38.648675 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3264f683-c657-4592-bb2b-b817f275b9b6 req-ce8a6f31-c789-4f06-a8d0-79aa96f2e776 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0694137 Nov 15 17:55:38.912210 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af701ab-c865-455d-a12e-533f20fb65d4 req-f50e12dd-5061-4a0a-b284-d63568ffc767 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:38.913656 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5af701ab-c865-455d-a12e-533f20fb65d4 req-f50e12dd-5061-4a0a-b284-d63568ffc767 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0529029 Nov 15 17:55:38.964780 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5af701ab-c865-455d-a12e-533f20fb65d4 req-6c5fdb99-7035-4ab0-a415-37c95d4139e9 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426452 Nov 15 17:55:39.781386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b36b33a-62b1-48f5-bb7a-3d03241c3487 req-88ced0ca-fd9c-4612-8237-c599e08f4de1 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:39.782789 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b36b33a-62b1-48f5-bb7a-3d03241c3487 req-88ced0ca-fd9c-4612-8237-c599e08f4de1 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0602334 Nov 15 17:55:39.835147 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b36b33a-62b1-48f5-bb7a-3d03241c3487 req-2e1d122a-18f1-402d-9fb0-6bc0cd68ccb4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462272 Nov 15 17:55:40.096960 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a27471-d5d5-4baf-b2ca-659c754e625d req-93cb2f1e-3442-4cf8-9199-976faa5898a9 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:40.098306 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-31a27471-d5d5-4baf-b2ca-659c754e625d req-93cb2f1e-3442-4cf8-9199-976faa5898a9 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0574322 Nov 15 17:55:40.151064 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-31a27471-d5d5-4baf-b2ca-659c754e625d req-b2d871b1-624f-406a-8134-52ff4a25b5cf tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.31 "GET /v2.0/security-groups?id=507605d6-1dbf-4ee1-8930-bec084b2bac9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436013 Nov 15 17:55:40.211230 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34669fa4-9462-4326-85d9-d7814254147c req-187bd301-dda3-4005-8d69-05c4cce9285d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:40.212762 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-34669fa4-9462-4326-85d9-d7814254147c req-187bd301-dda3-4005-8d69-05c4cce9285d tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.48 "GET /v2.0/ports?device_id=00950928-ae13-4173-93e6-e9a1ccab625a HTTP/1.1" status: 200 len: 950 time: 0.0546153 Nov 15 17:55:40.304389 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Deleting port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:55:40.304700 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:40.397254 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] For port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,segment=NetworkSegment(adea3c81-84f8-4338-a68e-9347d5ee6eec),segment_id=adea3c81-84f8-4338-a68e-9347d5ee6eec)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:40.397495 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:40.409502 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Calling delete_port for e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:55:40.540416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:40.554088 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['e95f6aac-f26e-4d96-9a39-b1c24e67d3e2'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:55:40.576008 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Pushing event deleted for resources: {'Port': ['ID=e95f6aac-f26e-4d96-9a39-b1c24e67d3e2,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:40.615289 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] No DVR routers for this DVR port e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:55:40.619289 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:40.622684 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-34669fa4-9462-4326-85d9-d7814254147c req-af734b9e-f64c-45c2-8d4c-562a083d6652 tempest-VolumesNegativeTest-124931203 tempest-VolumesNegativeTest-124931203-project] 10.222.0.48 "DELETE /v2.0/ports/e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 HTTP/1.1" status: 204 len: 173 time: 0.4021976 Nov 15 17:55:40.623117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'name': 'network-vif-deleted', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:40.625426 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d276e180-4482-4084-9888-a24481bb36f5" -d '{"events": [{"server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "name": "network-vif-deleted", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:40.663307 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4453479-1f98-486e-847d-6b73b034d0e5 x-openstack-request-id: req-d4453479-1f98-486e-847d-6b73b034d0e5 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:40.663718 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "00950928-ae13-4173-93e6-e9a1ccab625a", "name": "network-vif-deleted", "tag": "e95f6aac-f26e-4d96-9a39-b1c24e67d3e2", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:40.664061 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-d4453479-1f98-486e-847d-6b73b034d0e5 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:40.664446 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00950928-ae13-4173-93e6-e9a1ccab625a', 'name': 'network-vif-deleted', 'tag': 'e95f6aac-f26e-4d96-9a39-b1c24e67d3e2', 'status': 'completed', 'code': 200} Nov 15 17:55:40.950239 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bea5512-8c03-4045-8115-50cd3357cc76 req-92a2a193-64c1-4b3c-925e-b10a9353a00d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:40.951580 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0bea5512-8c03-4045-8115-50cd3357cc76 req-92a2a193-64c1-4b3c-925e-b10a9353a00d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0493302 Nov 15 17:55:41.005875 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0bea5512-8c03-4045-8115-50cd3357cc76 req-83469336-5136-4460-8883-7d1d180f4413 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453885 Nov 15 17:55:42.125416 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61ab73b-edd5-42c0-89c6-b8cdc980e941 req-3d3a3548-9791-4752-9741-3e491641ab32 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:42.127004 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d61ab73b-edd5-42c0-89c6-b8cdc980e941 req-3d3a3548-9791-4752-9741-3e491641ab32 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0498199 Nov 15 17:55:42.181784 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d61ab73b-edd5-42c0-89c6-b8cdc980e941 req-9f3401b5-f699-4c40-bd8d-1505ecab632e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485208 Nov 15 17:55:43.299959 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03aae952-f16b-4046-b153-cc177403c62d req-d1fd9813-aefd-408e-8b6e-128154e15e26 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:43.301516 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-03aae952-f16b-4046-b153-cc177403c62d req-d1fd9813-aefd-408e-8b6e-128154e15e26 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0518062 Nov 15 17:55:43.352569 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-03aae952-f16b-4046-b153-cc177403c62d req-2c66aa9e-255e-404e-be31-99f46630f4c5 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447347 Nov 15 17:55:44.477657 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9dcde10-9c37-4252-8a38-0388e87bc9c9 req-0bf6bd70-b2fe-4a09-85e6-3d1c1b2c6af3 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:44.479126 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c9dcde10-9c37-4252-8a38-0388e87bc9c9 req-0bf6bd70-b2fe-4a09-85e6-3d1c1b2c6af3 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0556695 Nov 15 17:55:44.533265 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c9dcde10-9c37-4252-8a38-0388e87bc9c9 req-910fea4a-7070-43a6-82b1-2eb8ca4e3ad9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453975 Nov 15 17:55:45.065904 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33112) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:45.203300 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-942f0a56-514d-4b1e-b40f-ce9b40609c6a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=69f691868a8c485384fb1495d4e1e832&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1361382 Nov 15 17:55:45.206905 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33116) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:45.256465 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:45.277206 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:45.326300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:45.328839 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:45.329948 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/507605d6-1dbf-4ee1-8930-bec084b2bac9 HTTP/1.1" status: 204 len: 168 time: 0.1221755 Nov 15 17:55:45.338064 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07980f86-0747-4a99-970b-8b6ee1b4ec14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=507605d6-1dbf-4ee1-8930-bec084b2bac9,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:45.423577 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:55:45.446900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:55:45.446900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device e95f6aac-f26e-4d96-9a39-b1c24e67d3e2 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:55:45.657293 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbce30f3-0917-4866-9b2e-5b67a85b2693 req-9e1757e4-54a7-4876-98d1-65e47b656c3a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:45.658814 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fbce30f3-0917-4866-9b2e-5b67a85b2693 req-9e1757e4-54a7-4876-98d1-65e47b656c3a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0553308 Nov 15 17:55:45.709506 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-fbce30f3-0917-4866-9b2e-5b67a85b2693 req-8d3f2664-ba51-44d7-90c3-cc8720baeb81 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436082 Nov 15 17:55:45.984154 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33140) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:46.089818 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-711297402-network', 'tenant_id': '418a337f482c4773a787a5a90721966a'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:46.119473 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Made reservation on behalf of 418a337f482c4773a787a5a90721966a for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:46.123080 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.136150 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.206055 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.212369 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.234675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] vlan segment allocate from pool success with {'vlan_id': 437, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:55:46.244324 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df99a6de-2c28-4a0b-b2b8-75a77c85fc4e,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:46.252933 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.253283 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Added segment d62f5f5e-b150-4fd9-8c65-68b3346d8ae0 of type vlan for network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec Nov 15 17:55:46.304058 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.333992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.335505 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:46.336533 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.392810 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4075813 Nov 15 17:55:46.395874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33144) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:46.397639 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb80debb-507c-4ae0-82fe-4feb33c80539 admin admin] Pushing event updated for resources: {'Network': ['ID=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:46.402003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Request body: {'subnet': {'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-711297402-subnet', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:46.407861 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:55:46.425673 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Made reservation on behalf of 418a337f482c4773a787a5a90721966a for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:46.428174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.594363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.645669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Pushing event updated for resources: {'Subnet': ['ID=908418a4-9235-410e-85b3-c01d93461c44,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:46.658848 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Checking segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:46.659281 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Network hostable DHCP agents. Network: ea8b085a-8c53-4bf9-a5ac-959d633cd3ec, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:55:46.677006 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:55:46.686745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, ea8b085a-8c53-4bf9-a5ac-959d633cd3ec) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:46.691051 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:46.691638 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.696271 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f904acbb-cfd1-492f-947f-3b33bb52dca2 None None] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:55:46.708255 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-9703d852-e442-4316-a3d2-2018a7a0bf5f admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3111551 Nov 15 17:55:46.710929 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33146) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:46.715192 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:46.737215 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.738340 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.795651 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.830992 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-890eb52d-7afa-4543-bf14-917d51be2c9a req-0aed28f8-b1f7-43df-a25d-f70243a4a791 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:46.832557 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-890eb52d-7afa-4543-bf14-917d51be2c9a req-0aed28f8-b1f7-43df-a25d-f70243a4a791 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 944 time: 0.0538445 Nov 15 17:55:46.856725 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:55:46.857956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.890720 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-890eb52d-7afa-4543-bf14-917d51be2c9a req-d25faef9-46a3-4357-b931-e31aa6fcd0e2 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517206 Nov 15 17:55:46.939130 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:46.986593 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Allocated IP 172.20.0.2 (ea8b085a-8c53-4bf9-a5ac-959d633cd3ec/908418a4-9235-410e-85b3-c01d93461c44/1b815aca-b900-454d-8ab9-02df678b9189) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:47.128245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.133189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.135946 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.152160 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.176806 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:47.179841 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:47.184377 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:47.187375 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Pushing event updated for resources: {'Port': ['ID=1b815aca-b900-454d-8ab9-02df678b9189,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:47.240944 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Attempting to bind port 1b815aca-b900-454d-8ab9-02df678b9189 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:47.241291 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Attempting to bind port 1b815aca-b900-454d-8ab9-02df678b9189 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:47.241645 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Attempting to bind port 1b815aca-b900-454d-8ab9-02df678b9189 on network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:47.247059 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:47.247436 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Checking segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:47.247856 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.248238 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Bound using segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:47.248701 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Bound port: 1b815aca-b900-454d-8ab9-02df678b9189, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:47.249093 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.258397 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Allocated IP 172.27.0.29 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/f952269a-2d08-495d-b368-70fcdc6d7b2f) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:47.310054 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] For port 1b815aca-b900-454d-8ab9-02df678b9189, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:47.313081 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] For port 1b815aca-b900-454d-8ab9-02df678b9189, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=1b815aca-b900-454d-8ab9-02df678b9189,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:47.318528 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.361445 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.372234 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1d4e5c-2261-4ba7-9412-264d9a5f20dd None None] Pushing event updated for resources: {'Port': ['ID=1b815aca-b900-454d-8ab9-02df678b9189,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:47.401724 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.435681 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device f5758317-a1ce-4645-bc74-a6fda94fcfb1 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:55:47.437889 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:47.443081 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:47.447660 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:47.477457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Pushing event updated for resources: {'Port': ['ID=f952269a-2d08-495d-b368-70fcdc6d7b2f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:47.565706 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:47.577110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 430, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:55:47.620417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.634240 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f5758317-a1ce-4645-bc74-a6fda94fcfb1 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:55:47.660474 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:47.666884 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.718230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:47.747446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:47.914680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['f5758317-a1ce-4645-bc74-a6fda94fcfb1'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:55:47.948985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.014297 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc98c88-47b2-4815-a91a-b19055fe05a5 req-3b67f213-7081-4dc4-b52f-3c1bc00c8c8d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:48.016787 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fc98c88-47b2-4815-a91a-b19055fe05a5 req-3b67f213-7081-4dc4-b52f-3c1bc00c8c8d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 945 time: 0.0539556 Nov 15 17:55:48.077454 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7fc98c88-47b2-4815-a91a-b19055fe05a5 req-87e75df4-e10f-495d-957d-7e262f7f0f00 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530629 Nov 15 17:55:48.095936 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Router 705e06c1-9692-44f5-9f70-49c868ee876e is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:55:48.217647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:48.228783 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f700885-050d-4417-880f-41091d014126 None None] Sync routers for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:48.237894 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.239294 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c496eacb-56e2-4fd2-9d45-86e3022ffb58 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 1.5274222 Nov 15 17:55:48.241524 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f700885-050d-4417-880f-41091d014126 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:48.242314 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-7f700885-050d-4417-880f-41091d014126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:48.242478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33152) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:48.282689 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3280320-ae24-4cfe-af49-06f185fd6519 None None] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:55:48.349937 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-7f700885-050d-4417-880f-41091d014126 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:48.410087 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] Provisioning complete for port 1b815aca-b900-454d-8ab9-02df678b9189 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:48.410452 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.527502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.545284 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-7f700885-050d-4417-880f-41091d014126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:47Z', 'revision_number': 3, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:48.564494 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] For port 1b815aca-b900-454d-8ab9-02df678b9189, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=1b815aca-b900-454d-8ab9-02df678b9189,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:48.573642 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.589376 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f700885-050d-4417-880f-41091d014126 None None] Checking router: 705e06c1-9692-44f5-9f70-49c868ee876e for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:48.589980 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f700885-050d-4417-880f-41091d014126 None None] Updating router 705e06c1-9692-44f5-9f70-49c868ee876e port f952269a-2d08-495d-b368-70fcdc6d7b2f binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:55:48.620185 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.645155 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bdd8faa-1e76-4005-8c75-a5222a0d9abd None None] Pushing event updated for resources: {'Port': ['ID=1b815aca-b900-454d-8ab9-02df678b9189,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:48.795793 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-298eee20-a56a-4673-85d9-e3a98697a486 None None] Provisioning complete for port 1b815aca-b900-454d-8ab9-02df678b9189 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:48.796450 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-298eee20-a56a-4673-85d9-e3a98697a486 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.871905 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.879268 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.932383 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-7f700885-050d-4417-880f-41091d014126 None None] Attempting to bind port f952269a-2d08-495d-b368-70fcdc6d7b2f on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:48.932746 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-7f700885-050d-4417-880f-41091d014126 None None] Attempting to bind port f952269a-2d08-495d-b368-70fcdc6d7b2f by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:48.933100 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f700885-050d-4417-880f-41091d014126 None None] Attempting to bind port f952269a-2d08-495d-b368-70fcdc6d7b2f on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:48.938360 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Pushing event updated for resources: {'Port': ['ID=f952269a-2d08-495d-b368-70fcdc6d7b2f,revision_number=2']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:48.945709 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f700885-050d-4417-880f-41091d014126 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:48.946196 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f700885-050d-4417-880f-41091d014126 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:48.946591 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.946964 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f700885-050d-4417-880f-41091d014126 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:48.947420 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-7f700885-050d-4417-880f-41091d014126 None None] Bound port: f952269a-2d08-495d-b368-70fcdc6d7b2f, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:48.947832 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:48.950848 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.951200 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.951532 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.951878 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.952204 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.952508 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.952822 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.953171 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.953490 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.953808 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.954114 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.954420 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:48.954985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.003645 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-7f700885-050d-4417-880f-41091d014126 None None] For port f952269a-2d08-495d-b368-70fcdc6d7b2f, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:49.006617 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-7f700885-050d-4417-880f-41091d014126 None None] For port f952269a-2d08-495d-b368-70fcdc6d7b2f, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=f952269a-2d08-495d-b368-70fcdc6d7b2f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:49.010883 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-7f700885-050d-4417-880f-41091d014126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.067683 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f700885-050d-4417-880f-41091d014126 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:49.068226 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-7f700885-050d-4417-880f-41091d014126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:49.071140 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a3dc83-541a-488e-9af9-f761b083e0d9 None None] Pushing event updated for resources: {'Port': ['ID=f952269a-2d08-495d-b368-70fcdc6d7b2f,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:49.112220 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Allocated IP 172.20.0.1 (ea8b085a-8c53-4bf9-a5ac-959d633cd3ec/908418a4-9235-410e-85b3-c01d93461c44/82acd1b8-c9a5-4835-9110-2ba619a5e57c) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:49.180002 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-7f700885-050d-4417-880f-41091d014126 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:49.189475 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83749dd-b1b5-4477-87c5-33ca609ae355 req-55e5e7bc-e24b-4f53-8ac7-399509d822b1 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:49.191546 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b83749dd-b1b5-4477-87c5-33ca609ae355 req-55e5e7bc-e24b-4f53-8ac7-399509d822b1 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 945 time: 0.0490017 Nov 15 17:55:49.221958 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.246296 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b83749dd-b1b5-4477-87c5-33ca609ae355 req-5cbfe204-c288-4dbe-b5c9-e73ec4c5022b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481033 Nov 15 17:55:49.259446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.298487 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:49.301328 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:49.304958 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:49.332450 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Pushing event updated for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:49.349923 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.367012 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-7f700885-050d-4417-880f-41091d014126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:47Z', 'revision_number': 3, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:49.395209 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f700885-050d-4417-880f-41091d014126 None None] The sync data for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi is: [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:47Z', 'revision_number': 3, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:49.430867 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device f5758317-a1ce-4645-bc74-a6fda94fcfb1 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:49.514577 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.517636 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port f5758317-a1ce-4645-bc74-a6fda94fcfb1 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:55:49.525900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port f5758317-a1ce-4645-bc74-a6fda94fcfb1 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:49.526257 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.635939 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 1b815aca-b900-454d-8ab9-02df678b9189 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:49.638625 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-96156e15-8790-4b4b-89a6-28ac51013c02 None None] Provisioning complete for port 82acd1b8-c9a5-4835-9110-2ba619a5e57c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:49.639039 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-96156e15-8790-4b4b-89a6-28ac51013c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.642251 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.737606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:49.739931 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a979bcf-d189-4e74-8f03-632e04046f0a" -d '{"events": [{"server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "name": "network-vif-plugged", "status": "completed", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:49.747507 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-96156e15-8790-4b4b-89a6-28ac51013c02 None None] Port 82acd1b8-c9a5-4835-9110-2ba619a5e57c cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:49.758396 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:49.761807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.767792 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.768432 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.777381 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 1b815aca-b900-454d-8ab9-02df678b9189 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:49.777752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.811196 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c557f618-ac53-487a-a1a9-f31e4668baeb x-openstack-request-id: req-c557f618-ac53-487a-a1a9-f31e4668baeb {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:49.812245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "name": "network-vif-plugged", "status": "completed", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:49.812671 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c557f618-ac53-487a-a1a9-f31e4668baeb {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:49.813212 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'code': 200} Nov 15 17:55:49.852575 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:49.859326 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Pushing event updated for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:49.878704 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:49.967668 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:49.969401 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:50.097244 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8468b8-e31f-47a5-a1c8-0d02abbdc099 req-6567bebd-abb4-4289-8f0a-c4e6ead45a84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:50.098768 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-af8468b8-e31f-47a5-a1c8-0d02abbdc099 req-6567bebd-abb4-4289-8f0a-c4e6ead45a84 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1099 time: 0.0848114 Nov 15 17:55:50.132984 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Router 705e06c1-9692-44f5-9f70-49c868ee876e has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:55:50.172044 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-af8468b8-e31f-47a5-a1c8-0d02abbdc099 req-bee0b963-5179-458b-9ed7-f122c4922eb3 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644636 Nov 15 17:55:50.266517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:50.277151 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e835604f-59c0-4a5d-948a-efafcee93378 None None] Provisioning complete for port 82acd1b8-c9a5-4835-9110-2ba619a5e57c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:50.277486 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-114bf2e5-81ad-4969-a971-3493a8320591 admin admin] 10.222.0.31 "PUT /v2.0/routers/705e06c1-9692-44f5-9f70-49c868ee876e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0293388 Nov 15 17:55:50.277585 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e835604f-59c0-4a5d-948a-efafcee93378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.315996 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e835604f-59c0-4a5d-948a-efafcee93378 None None] Port 82acd1b8-c9a5-4835-9110-2ba619a5e57c cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:50.375345 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-702785e2-815d-4ff3-9328-de2d316a2f45 req-6495dcaf-c3b4-453e-baf2-736583945c43 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:50.376976 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-702785e2-815d-4ff3-9328-de2d316a2f45 req-6495dcaf-c3b4-453e-baf2-736583945c43 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.0505412 Nov 15 17:55:50.428101 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-702785e2-815d-4ff3-9328-de2d316a2f45 req-991a8e78-a670-48ee-8861-1a2bc26290bb tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450385 Nov 15 17:55:50.758662 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33174) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:50.763868 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1169451319-network', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:50.784933 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Made reservation on behalf of 99fca80b5c8548b0a4717185841f27b3 for: {'network': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:50.787380 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.796161 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.874741 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.879676 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.903059 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] vlan segment allocate from pool success with {'vlan_id': 442, 'physical_network': 'physnet1'} {{(pid=108141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:55:50.913149 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cad08d99-ee45-44ba-9bdc-697031e1f170,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:50.917867 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.918192 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.segments_db [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Added segment dcb016f8-fafb-4b53-ab1d-6042fadd5d07 of type vlan for network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 Nov 15 17:55:50.959086 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.989958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:50.991318 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:50.991928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.041507 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.2815638 Nov 15 17:55:51.044669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33176) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:51.049750 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Request body: {'subnet': {'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1169451319-subnet', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'ip_version': 4}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:51.052787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9ea2e9-3750-46c1-970d-c090e346db02 admin admin] Pushing event updated for resources: {'Network': ['ID=385ed69e-2c30-483e-bdd6-a8942b0fe2d0,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:51.063665 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:55:51.074234 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Made reservation on behalf of 99fca80b5c8548b0a4717185841f27b3 for: {'subnet': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:55:51.076601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-58888495'] for subnet, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.116135 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Sync routers for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:51.141616 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:51.142304 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:51.246332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:51.248760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59364713', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-58888509'] for subnet, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.310395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dc325d00-5dbf-4c73-865a-c2ec647b9645,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:51.323343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Checking segment: {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:51.324408 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Network hostable DHCP agents. Network: 385ed69e-2c30-483e-bdd6-a8942b0fe2d0, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:55:51.344403 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:55:51.354807 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 385ed69e-2c30-483e-bdd6-a8942b0fe2d0) {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:51.359101 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:51.359851 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.378312 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-0aa428ce-57ff-4d3b-90bc-797c83f9b1e3 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3319833 Nov 15 17:55:51.380579 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33178) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:51.386080 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:51.403578 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e3c552f-4204-42c6-946e-332ebbbee368 None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:55:51.410822 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.412041 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.465771 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.621516 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device f952269a-2d08-495d-b368-70fcdc6d7b2f up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:51.636752 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.657570 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731e1b6-5f6f-4b27-b224-7a9f9dacca19 req-b3257aba-2696-4fa7-aaa8-d844fdd3cb61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:51.659121 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8731e1b6-5f6f-4b27-b224-7a9f9dacca19 req-b3257aba-2696-4fa7-aaa8-d844fdd3cb61 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.1484394 Nov 15 17:55:51.735087 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'fixed_ips': [{'subnet_id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:55:51.735988 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.751024 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8731e1b6-5f6f-4b27-b224-7a9f9dacca19 req-a589981d-7acd-4215-9ceb-a9c61e76d363 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0800819 Nov 15 17:55:51.755511 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port f952269a-2d08-495d-b368-70fcdc6d7b2f triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:51.755904 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.875475 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 2, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:51.910898 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Checking router: 705e06c1-9692-44f5-9f70-49c868ee876e for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:51.911179 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Updating router 705e06c1-9692-44f5-9f70-49c868ee876e port 82acd1b8-c9a5-4835-9110-2ba619a5e57c binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:55:51.932688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157584af-be67-4709-9698-acc532927e67 req-79b5c716-7814-4949-bc8f-3bcd73db97ff tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:51.934195 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-157584af-be67-4709-9698-acc532927e67 req-79b5c716-7814-4949-bc8f-3bcd73db97ff tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.0831902 Nov 15 17:55:51.935686 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.963329 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:51.991519 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.006186 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.031844 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Allocated IP 172.20.0.2 (385ed69e-2c30-483e-bdd6-a8942b0fe2d0/dc325d00-5dbf-4c73-865a-c2ec647b9645/0ecc245e-a080-4f1a-ae90-6eec3b13cf5c) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:52.037132 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port f952269a-2d08-495d-b368-70fcdc6d7b2f, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=f952269a-2d08-495d-b368-70fcdc6d7b2f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:52.047675 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-157584af-be67-4709-9698-acc532927e67 req-8192dbb9-0f2e-4137-a673-cfb49e81882e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0907290 Nov 15 17:55:52.071509 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33184) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:52.073915 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.102033 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Allocated IP 172.27.0.231 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/0df2c911-d7e8-49a5-a5a2-a6a29c05fccb) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:52.115051 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f6ad910-988f-4dcc-b5af-8e02d2a6df17 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:52.119831 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8f6ad910-988f-4dcc-b5af-8e02d2a6df17 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1094 time: 0.0436177 Nov 15 17:55:52.120058 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33186) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:52.124487 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address': '172.20.0.13'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:52.147683 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.230471 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=f952269a-2d08-495d-b368-70fcdc6d7b2f,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.255290 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.376775 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.393138 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.435405 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.447525 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.454104 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:52.464077 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:52.482912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.484479 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:52.494958 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Pushing event updated for resources: {'Port': ['ID=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.523296 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:52.527956 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:52.531217 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.532423 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:52.551958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Pushing event updated for resources: {'Port': ['ID=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.552838 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.27.0.133 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/ee6c9aed-267c-49b1-aa83-71b8c8a621d6) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:52.555541 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.566801 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Attempting to bind port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:52.567160 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Attempting to bind port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:52.567511 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Attempting to bind port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c on network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:52.599739 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:52.600176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Checking segment: {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:52.600571 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.600956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Bound using segment: {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:52.601437 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Bound port: 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:52.601795 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.668768 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17cb7ca-0744-44bd-bd11-dcdc07ef8c9b None None] Pushing event updated for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.688920 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.720710 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Attempting to bind port 82acd1b8-c9a5-4835-9110-2ba619a5e57c on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:52.721077 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Attempting to bind port 82acd1b8-c9a5-4835-9110-2ba619a5e57c by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:52.721430 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Attempting to bind port 82acd1b8-c9a5-4835-9110-2ba619a5e57c on network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:52.730089 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:52.730483 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Checking segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:52.730843 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.731228 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Bound using segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:52.731751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Bound port: 82acd1b8-c9a5-4835-9110-2ba619a5e57c, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:52.732119 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.734417 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] For port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:52.738067 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.738242 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] For port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:52.773730 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.776630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:52.779985 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:52.784001 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:52.833091 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eefb411-f683-44f7-9bcd-e3a49ce1b722 None None] Pushing event updated for resources: {'Port': ['ID=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.845926 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.880780 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] For port 82acd1b8-c9a5-4835-9110-2ba619a5e57c, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:52.885494 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=ee6c9aed-267c-49b1-aa83-71b8c8a621d6,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:52.888900 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] For port 82acd1b8-c9a5-4835-9110-2ba619a5e57c, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=82acd1b8-c9a5-4835-9110-2ba619a5e57c,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:52.900930 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:52.956194 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:52.956983 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:53.088615 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.247302 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17cb7ca-0744-44bd-bd11-dcdc07ef8c9b None None] Pushing event updated for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:53.253937 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] Provisioning complete for port 82acd1b8-c9a5-4835-9110-2ba619a5e57c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:53.254447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.271555 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.341454 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Router 60b02c33-2600-4471-baf3-761be4616c65 is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:55:53.366228 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:53.379844 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.417048 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.462087 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:53.481834 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Sync routers for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:53.494646 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.495344 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-00f0dfb9-8c1e-4d1a-a00a-f46d4f885d48 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.1136596 Nov 15 17:55:53.499184 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33188) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:53.506672 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:53.507391 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:53.530195 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] For port 82acd1b8-c9a5-4835-9110-2ba619a5e57c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=82acd1b8-c9a5-4835-9110-2ba619a5e57c,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:53.543401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.613351 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.620478 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.642953 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954132eb-7c95-41fe-9753-f92184fab406 None None] Pushing event updated for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:53.645260 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:53.677833 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-7e416499-f527-4273-b6f9-c54446ab2c01 None None] Provisioning complete for port 82acd1b8-c9a5-4835-9110-2ba619a5e57c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:53.678340 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7e416499-f527-4273-b6f9-c54446ab2c01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.742475 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:53.745022 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:53.811516 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f128324-eaa1-4ab7-859a-b0f675620818 None None] The sync data for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi is: [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:53.813745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=ee6c9aed-267c-49b1-aa83-71b8c8a621d6,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:53.817099 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:53.948461 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 37d45a79-70e4-4439-857b-472e6d802cb0 associated. External IP: 172.27.0.133, port: f5758317-a1ce-4645-bc74-a6fda94fcfb1. Nov 15 17:55:54.001543 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 3, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:54.018220 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:54.018851 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.178258 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.204370 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Checking router: 60b02c33-2600-4471-baf3-761be4616c65 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:54.204986 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Updating router 60b02c33-2600-4471-baf3-761be4616c65 port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:55:54.249023 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:54.256833 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.261901 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.263159 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device f952269a-2d08-495d-b368-70fcdc6d7b2f up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:54.337094 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:55:54.345261 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.366041 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b411cc05-850f-43b6-874f-3ab3e20472dc None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:55:54.390967 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:54.477198 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-5194837b-ef50-4195-93cb-baa0814237d8 None None] Provisioning complete for port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:54.477597 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5194837b-ef50-4195-93cb-baa0814237d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.496056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:54.527613 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.532110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:54.566239 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port f952269a-2d08-495d-b368-70fcdc6d7b2f triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:54.566607 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.569419 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-74dffbc4-ce73-4839-a8e3-f1d8b8edf24e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4482443 Nov 15 17:55:54.570141 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:55:54.574564 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77" -d '{"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:55:54.617389 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Allocated IP 172.20.0.1 (385ed69e-2c30-483e-bdd6-a8942b0fe2d0/dc325d00-5dbf-4c73-865a-c2ec647b9645/b961a051-c737-4748-bb22-9c4491891c5c) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:55:54.621951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:54.622591 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:54.629225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:55:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-795ba51b-18ae-49f6-a2bc-39485a01628a x-openstack-request-id: req-795ba51b-18ae-49f6-a2bc-39485a01628a {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:55:54.629860 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:55:54.630536 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-795ba51b-18ae-49f6-a2bc-39485a01628a {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:55:54.631104 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'status': 'completed', 'code': 200} Nov 15 17:55:54.706130 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-fbf2c093-2e8e-4387-9d45-673a9c81a7d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:54.708023 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-fbf2c093-2e8e-4387-9d45-673a9c81a7d5 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1099 time: 0.0501058 Nov 15 17:55:54.726322 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.742246 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.802361 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Attempting to bind port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:54.802861 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Attempting to bind port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:54.803312 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Attempting to bind port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:54.814524 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:54.815401 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:54.815644 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.816178 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:54.817041 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Bound port: 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:54.817527 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.820491 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c1da91-f2b6-4ce7-bc25-ff230edfe147 None None] Pushing event updated for resources: {'Port': ['ID=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,revision_number=2']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:54.824839 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.879677 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] For port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:54.883640 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] For port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:54.886403 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.892865 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:54.901579 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-0d6a8d26-ffc9-4552-9dbd-649980c3f41b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:54.903118 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-0d6a8d26-ffc9-4552-9dbd-649980c3f41b service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.1847508 Nov 15 17:55:54.940721 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Pushing event updated for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:54.965090 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.965548 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.967759 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.968312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.968660 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.969001 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.969558 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.969791 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.970151 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.970483 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.970809 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.971116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:54.975197 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:54.975858 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:54.976061 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:54.978087 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:54.982311 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:55:55.015009 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:55.015925 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-a223d373-e858-436e-8b18-ea98be738c51 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 1000 time: 0.1040936 Nov 15 17:55:55.055014 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.061407 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c1da91-f2b6-4ce7-bc25-ff230edfe147 None None] Pushing event updated for resources: {'Port': ['ID=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:55.101995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-c2c3194a-b403-4d9e-a93b-97e902ba6e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:55.105388 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-c2c3194a-b403-4d9e-a93b-97e902ba6e90 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0809526 Nov 15 17:55:55.145848 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:55.309363 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.433439 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:55.450892 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 3, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:55.495659 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5062b1d4-accb-4172-901a-5a99d60e5ed6 None None] The sync data for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi is: [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 3, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:55.517606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:55.546292 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:55.546948 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:55.547506 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.553523 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-3d3b70af-8435-4457-bdfb-5b85dc5e2409 None None] Provisioning complete for port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:55.553955 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3d3b70af-8435-4457-bdfb-5b85dc5e2409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.557386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.673247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:55.675481 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Pushing event updated for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:55.785512 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:55:55.787211 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:55:55.791840 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-87baec3c-b4ec-4c44-8902-6fb564186614 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:55:55.793353 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-87baec3c-b4ec-4c44-8902-6fb564186614 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.6795790 Nov 15 17:55:55.864339 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 82acd1b8-c9a5-4835-9110-2ba619a5e57c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:55.926066 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-c7bef13f-9964-41b2-863e-c452765896ca service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238379 Nov 15 17:55:55.953024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Router 60b02c33-2600-4471-baf3-761be4616c65 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:55:56.044584 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:56.074704 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-646dba3b-5d13-4cad-a6fa-d7ec23d4aa77 req-26d44f56-2a85-4430-a7ed-d5d451e2108c service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1393282 Nov 15 17:55:56.128718 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:55:56.134526 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f001cf41-e58c-4e65-9668-30522a97fda6 admin admin] 10.222.0.31 "PUT /v2.0/routers/60b02c33-2600-4471-baf3-761be4616c65/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6340973 Nov 15 17:55:56.136282 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 82acd1b8-c9a5-4835-9110-2ba619a5e57c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:56.136282 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.340261 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:56.387566 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-9190bef0-88ac-4f20-8e15-28e876bea77e None None] Provisioning complete for port b961a051-c737-4748-bb22-9c4491891c5c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:56.387980 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9190bef0-88ac-4f20-8e15-28e876bea77e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.454319 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-9190bef0-88ac-4f20-8e15-28e876bea77e None None] Port b961a051-c737-4748-bb22-9c4491891c5c cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:56.474855 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:56.475228 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.516833 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:56.553600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bb116b-5a83-4ed3-8394-0aafbac215e0 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:56.685292 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33202) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:56.690138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1905699570', 'description': 'tempest-secgroup-smoke-1905699570 description', 'project_id': '418a337f482c4773a787a5a90721966a'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:56.714534 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.776534 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d33c00f4-eb66-49f5-a529-10b3271fb732 None None] New status for floating IP 37d45a79-70e4-4439-857b-472e6d802cb0: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:55:56.784811 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.789286 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.817342 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.821477 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1322789 Nov 15 17:55:56.822003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33204) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:56.822691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a8dd89d-73db-4f93-a0df-d01214845d04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4c4d31bc-10ad-4e45-b360-da275ad788a7,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:56.827494 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:56.855918 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.911335 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.915203 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.934337 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f806033-61b8-4e20-9169-04a7ec04c901,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:56.942637 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.942984 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.943320 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.943651 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.944006 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.944324 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.944642 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.944978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.945279 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.945599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.945912 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.946224 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:55:56.950793 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:56.952008 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-1a61e78d-894b-4f9f-97d9-e493191b466c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1287665 Nov 15 17:55:56.954859 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33206) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:56.959208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:56.986086 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.040074 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.046410 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.073039 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea91d5b3-52cd-4d19-907d-dd7dfc91cf4a,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:57.078599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.082754 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c2b6c824-1c42-4ca0-aeb9-34ad90ecaf12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1268749 Nov 15 17:55:57.082962 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33208) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:57.087572 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:57.116201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.171813 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.176683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.194108 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=648b1010-d456-489e-a100-aaae85d8542f,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:57.201300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.202554 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7993aa4e-549b-42ca-bfeb-1e4d978b929b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1186073 Nov 15 17:55:57.205494 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33210) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:57.210071 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:57.238436 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.302390 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.307874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.325321 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9ad985c-fc7d-4eb3-bfd8-cd27041035f1,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:57.334179 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.335391 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-0c4c9331-b3f8-4c9e-becb-1dccc66517a9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1289177 Nov 15 17:55:57.338274 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33212) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:57.342754 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:57.365172 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.securitygroups_db [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Project 418a337f482c4773a787a5a90721966a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:55:57.370595 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.428698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.433532 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.452566 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ea243d6-0084-4eb9-8e31-ed4bd901330a,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:57.461915 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.463316 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-6d993be7-0b51-47b6-a3e1-31c9edafd9e2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1240799 Nov 15 17:55:57.466225 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33214) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:55:57.470880 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'security_group_rule': {'security_group_id': '4c4d31bc-10ad-4e45-b360-da275ad788a7', 'project_id': '418a337f482c4773a787a5a90721966a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:55:57.494541 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.securitygroups_db [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Project 418a337f482c4773a787a5a90721966a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:55:57.499688 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.570334 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.574600 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.594954 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8ae5c0e-0bd1-4fdf-b6d3-3032b170652c,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:57.601918 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.610173 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b1c179f7-b2eb-40a1-83e7-cd066a076502 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1359265 Nov 15 17:55:57.614882 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Sync routers for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:55:57.622063 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:57.659658 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:57.660360 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:57.762690 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:57.763051 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:57.796426 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:57.961449 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.002143 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:58.006304 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.086040 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:58.097859 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:55Z', 'revision_number': 4, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b961a051-c737-4748-bb22-9c4491891c5c', 'name': '', 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'mac_address': 'fa:16:3e:65:c5:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_interface', 'standard_attr_id': 616, 'fixed_ips': [{'subnet_id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:54Z', 'updated_at': '2021-11-15T17:55:55Z', 'revision_number': 2, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'subnets': [{'id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:58.125874 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Checking router: 60b02c33-2600-4471-baf3-761be4616c65 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:55:58.126245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Updating router 60b02c33-2600-4471-baf3-761be4616c65 port b961a051-c737-4748-bb22-9c4491891c5c binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:55:58.155217 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.418775 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.425621 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.475402 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5bf846a-a0f9-44b8-afa9-d5aa64f33d00 None None] Pushing event updated for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:58.667385 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Attempting to bind port b961a051-c737-4748-bb22-9c4491891c5c on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:55:58.667985 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Attempting to bind port b961a051-c737-4748-bb22-9c4491891c5c by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:55:58.668114 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Attempting to bind port b961a051-c737-4748-bb22-9c4491891c5c on network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:55:58.673571 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:55:58.674628 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Checking segment: {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:55:58.675124 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.675607 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Bound using segment: {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:55:58.676369 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Bound port: b961a051-c737-4748-bb22-9c4491891c5c, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:55:58.676917 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.723484 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-d8799e3b-aa2e-46b9-b4e3-4ae807db91e6 None None] Provisioning complete for port b961a051-c737-4748-bb22-9c4491891c5c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:58.723756 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d8799e3b-aa2e-46b9-b4e3-4ae807db91e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.778140 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-d8799e3b-aa2e-46b9-b4e3-4ae807db91e6 None None] Port b961a051-c737-4748-bb22-9c4491891c5c cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:55:58.781783 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] For port b961a051-c737-4748-bb22-9c4491891c5c, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:55:58.785073 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] For port b961a051-c737-4748-bb22-9c4491891c5c, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b961a051-c737-4748-bb22-9c4491891c5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:55:58.789849 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:58.848969 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:55:58.849585 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:55:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:58.855193 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5bf846a-a0f9-44b8-afa9-d5aa64f33d00 None None] Pushing event updated for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:58.962189 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:55:59.125311 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] Provisioning complete for port b961a051-c737-4748-bb22-9c4491891c5c triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:59.125676 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:59.247303 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:55Z', 'revision_number': 4, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b961a051-c737-4748-bb22-9c4491891c5c', 'name': '', 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'mac_address': 'fa:16:3e:65:c5:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_interface', 'standard_attr_id': 616, 'fixed_ips': [{'subnet_id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:54Z', 'updated_at': '2021-11-15T17:55:58Z', 'revision_number': 4, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'subnets': [{'id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:55:59.250209 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:59.274711 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f73f7062-2169-4b31-aad0-3b438556c60c None None] The sync data for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi is: [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:55Z', 'revision_number': 4, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b961a051-c737-4748-bb22-9c4491891c5c', 'name': '', 'network_id': '385ed69e-2c30-483e-bdd6-a8942b0fe2d0', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'mac_address': 'fa:16:3e:65:c5:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_interface', 'standard_attr_id': 616, 'fixed_ips': [{'subnet_id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:54Z', 'updated_at': '2021-11-15T17:55:58Z', 'revision_number': 4, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'subnets': [{'id': 'dc325d00-5dbf-4c73-865a-c2ec647b9645', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:55:59.308182 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] For port b961a051-c737-4748-bb22-9c4491891c5c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b961a051-c737-4748-bb22-9c4491891c5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:55:59.314192 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:59.368340 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd58ba8-4043-4bd7-be1c-3dbd8f3c49d7 None None] Pushing event updated for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:55:59.654038 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:59.714287 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:59.714997 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:55:59.791623 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b961a051-c737-4748-bb22-9c4491891c5c up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:55:59.841451 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b961a051-c737-4748-bb22-9c4491891c5c triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:55:59.841797 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:00.790214 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d90de402-db34-4e94-9bf3-d86d2e295c5e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:03.094781 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-afe70cf8-a328-4c60-9718-4026c358056c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:04.481752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:05.603514 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:06.671895 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:07.529176 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5461d514-2244-49da-8e5f-54bb5746cf22 req-9d364f23-2f4c-4ffd-a4d9-aebb8db8fd56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:07.530862 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5461d514-2244-49da-8e5f-54bb5746cf22 req-9d364f23-2f4c-4ffd-a4d9-aebb8db8fd56 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 946 time: 0.0507810 Nov 15 17:56:07.580618 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5461d514-2244-49da-8e5f-54bb5746cf22 req-208265ee-22d7-455c-8449-bcf2beafa3a9 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431912 Nov 15 17:56:08.056243 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:56:08.715284 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29791648-32ad-44cd-b7d2-3d252f6cc4d4 req-89f657ff-5643-4d05-9560-350b37bbb4b0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:08.716768 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29791648-32ad-44cd-b7d2-3d252f6cc4d4 req-89f657ff-5643-4d05-9560-350b37bbb4b0 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 946 time: 0.0537848 Nov 15 17:56:08.772146 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-29791648-32ad-44cd-b7d2-3d252f6cc4d4 req-cf905477-5215-4aea-ae58-b40b60a8a0c1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups?id=d4010d4b-711f-4151-a3f1-d93907a44e0a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466471 Nov 15 17:56:09.054087 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-943b126f-58fd-4874-a840-b293db005702 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:09.055547 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-943b126f-58fd-4874-a840-b293db005702 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 946 time: 0.0527942 Nov 15 17:56:09.151165 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Deleting port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:09.151508 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.246753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] For port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:09.247132 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.421369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.421837 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.422238 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Floating IP 751cca9b-f6db-4508-b8df-0f307eba1dd5 disassociated. External IP: 172.27.0.124, port: c13f1e6c-0ca0-42d7-9725-f91a42d82e8c. Nov 15 17:56:09.422606 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Calling delete_port for c13f1e6c-0ca0-42d7-9725-f91a42d82e8c owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:09.562682 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.598917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'Port': ['ID=c13f1e6c-0ca0-42d7-9725-f91a42d82e8c,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:09.722874 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:56:09.836371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:09.847515 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:09.860615 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:09.861721 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:09.875782 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3d2e27f2-1562-4833-bc04-9accf97dd75d req-547719a0-8979-4a31-8e5a-70f7fb6c45b6 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/ports?device_id=50f00a65-1dfd-4694-bcc0-d73369c50bae HTTP/1.1" status: 200 len: 210 time: 0.0303886 Nov 15 17:56:09.885823 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] No DVR routers for this DVR port c13f1e6c-0ca0-42d7-9725-f91a42d82e8c on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:56:09.888875 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:09.892967 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-33af5202-3e5e-44ea-9381-d0768bee3ba0 req-f1987256-e491-4948-8ea4-66d299b9faf2 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.48 "DELETE /v2.0/ports/c13f1e6c-0ca0-42d7-9725-f91a42d82e8c HTTP/1.1" status: 204 len: 173 time: 0.8293905 Nov 15 17:56:09.893553 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-deleted', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:56:09.896047 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9ec430a-cfd6-4248-9dc9-3f796141e832" -d '{"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-deleted", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:56:09.943996 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:56:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6927b547-ba65-4cab-a444-7342b00502a1 x-openstack-request-id: req-6927b547-ba65-4cab-a444-7342b00502a1 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:56:09.944286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50f00a65-1dfd-4694-bcc0-d73369c50bae", "name": "network-vif-deleted", "tag": "c13f1e6c-0ca0-42d7-9725-f91a42d82e8c", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:56:09.944538 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-6927b547-ba65-4cab-a444-7342b00502a1 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:56:09.944935 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50f00a65-1dfd-4694-bcc0-d73369c50bae', 'name': 'network-vif-deleted', 'tag': 'c13f1e6c-0ca0-42d7-9725-f91a42d82e8c', 'status': 'completed', 'code': 200} Nov 15 17:56:09.970543 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:10.175784 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:10.201267 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:10.209584 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:10.210175 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:10.316379 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:10.615684 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-92e1fe35-670b-4431-a158-9837848a310a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:10.642582 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e1fe35-670b-4431-a158-9837848a310a None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:49:40Z', 'revision_number': 4, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'a8112831-21d6-4674-bd6b-bbb20d57e836', 'name': '', 'network_id': '927b3da0-f3f2-41e8-b00d-4ab5e71093d8', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'mac_address': 'fa:16:3e:81:83:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 271, 'fixed_ips': [{'subnet_id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:39Z', 'updated_at': '2021-11-15T17:49:44Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'subnets': [{'id': '82578c0d-639e-4df9-bec7-8ae336a8ba92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:10.855894 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09d766f9-61c7-4951-b4d9-d445eae48fa6 None None] New status for floating IP 751cca9b-f6db-4508-b8df-0f307eba1dd5: DOWN {{(pid=108143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:56:10.970083 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33334) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:11.024723 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.049368 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.101072 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.105661 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.107229 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "DELETE /v2.0/security-groups/d4010d4b-711f-4151-a3f1-d93907a44e0a HTTP/1.1" status: 204 len: 168 time: 0.1361084 Nov 15 17:56:11.110117 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33336) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:11.116767 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c392d90-bd28-469d-822e-d18a29d820bf tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4010d4b-711f-4151-a3f1-d93907a44e0a,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:11.126900 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.api.v2.resource [None req-317f9450-695d-465e-9e69-706a2f52faf1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] show failed (client error): The resource could not be found. Nov 15 17:56:11.130934 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33338) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:11.131100 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-317f9450-695d-465e-9e69-706a2f52faf1 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "GET /v2.0/security-groups/d4010d4b-711f-4151-a3f1-d93907a44e0a HTTP/1.1" status: 404 len: 347 time: 0.0198488 Nov 15 17:56:11.254957 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Deleting port 862f48bf-1dfa-4007-8c43-caa7631ca8bc {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:11.255251 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.339530 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.339896 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.351686 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Calling delete_port for 862f48bf-1dfa-4007-8c43-caa7631ca8bc owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:11.720550 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.746103 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Pushing event deleted for resources: {'Port': ['ID=862f48bf-1dfa-4007-8c43-caa7631ca8bc,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:11.805093 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.807546 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:11.808742 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-b98608dd-6488-4d91-933e-f94f82125d54 tempest-AttachVolumeShelveTestJSON-831876962 tempest-AttachVolumeShelveTestJSON-831876962-project] 10.222.0.31 "DELETE /v2.0/floatingips/751cca9b-f6db-4508-b8df-0f307eba1dd5 HTTP/1.1" status: 204 len: 168 time: 0.6767786 Nov 15 17:56:13.562163 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:56:13.582426 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: c13f1e6c-0ca0-42d7-9725-f91a42d82e8c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:56:13.582768 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device c13f1e6c-0ca0-42d7-9725-f91a42d82e8c not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:56:14.217363 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33368) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:14.745455 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:15.036500 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-10da578a-8eda-4ab3-b097-f155b533dda2 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1905699570&fields=id&tenant_id=418a337f482c4773a787a5a90721966a HTTP/1.1" status: 200 len: 267 time: 0.0576644 Nov 15 17:56:15.042060 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Deleting port a8112831-21d6-4674-bd6b-bbb20d57e836 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:15.042400 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:15.193325 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] For port a8112831-21d6-4674-bd6b-bbb20d57e836, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a8112831-21d6-4674-bd6b-bbb20d57e836,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:15.193575 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:15.213509 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-792cbc60-1959-44d1-ae61-95413bfe2116 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:15.214949 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-792cbc60-1959-44d1-ae61-95413bfe2116 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 808 time: 0.1706953 Nov 15 17:56:15.215836 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Calling delete_port for a8112831-21d6-4674-bd6b-bbb20d57e836 owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:15.236825 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-314561f6-e6da-4c53-87da-e896b5a409a6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/quotas/418a337f482c4773a787a5a90721966a HTTP/1.1" status: 200 len: 375 time: 0.0153337 Nov 15 17:56:15.360922 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-d22c3952-0df9-460d-a31a-447f3bb54edf tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0934665 Nov 15 17:56:15.501888 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-0a079e17-5978-469a-a5c7-fc794ea463bd service neutron] 10.222.0.31 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257324 Nov 15 17:56:15.516847 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:15.578103 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Pushing event deleted for resources: {'Port': ['ID=a8112831-21d6-4674-bd6b-bbb20d57e836,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:15.670961 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-75a96b30-f238-4db0-8293-21f0136595ac service neutron] 10.222.0.31 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1627796 Nov 15 17:56:15.770770 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:15.978064 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-162fee89-dcd6-4cfb-9441-59b0d894701a req-21d3bf1c-88e8-497b-83bd-23adbdf71ce0 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 210 time: 0.0326028 Nov 15 17:56:16.014017 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Router 74405065-b5c8-4585-a4db-196d01c514b1 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:56:16.117814 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:16.122914 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e7e80158-e6b5-46e6-a550-8a0a68fa3a90 admin admin] 10.222.0.31 "PUT /v2.0/routers/74405065-b5c8-4585-a4db-196d01c514b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9043536 Nov 15 17:56:16.125741 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33392) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:16.127434 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Sync routers for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:16.138130 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:16.138865 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:16.237587 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks [] for router, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.245467 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:16.353193 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.408275 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Deleting port c7c19085-c04e-438d-8d0f-77bd0df3a2d5 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:16.408601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.429537 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224'}], 'enable_snat': True}, 'gw_port_id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:56:15Z', 'revision_number': 5, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port': {'id': 'c7c19085-c04e-438d-8d0f-77bd0df3a2d5', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:80:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74405065-b5c8-4585-a4db-196d01c514b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:49:37Z', 'updated_at': '2021-11-15T17:49:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:16.456878 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Checking router: 74405065-b5c8-4585-a4db-196d01c514b1 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:16.465374 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Routers {'74405065-b5c8-4585-a4db-196d01c514b1'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:16.465992 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['74405065-b5c8-4585-a4db-196d01c514b1'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:16.493702 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] For port c7c19085-c04e-438d-8d0f-77bd0df3a2d5, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:16.494115 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.505929 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Calling delete_port for c7c19085-c04e-438d-8d0f-77bd0df3a2d5 owned by network:router_gateway {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:16.552235 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] Set router 74405065-b5c8-4585-a4db-196d01c514b1 gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:16.604319 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:56:16Z', 'revision_number': 6, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:16.630451 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1af42b1-b1e0-4e47-b9af-07334a39b7a0 None None] The sync data for ids ['74405065-b5c8-4585-a4db-196d01c514b1'] in dv-cinder-788366-7-iscsi is: [{'id': '74405065-b5c8-4585-a4db-196d01c514b1', 'name': 'tempest-AttachVolumeShelveTestJSON-2024315630-router', 'tenant_id': '8d7c8a074d704613bf45e1c8d95834e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:49:36Z', 'updated_at': '2021-11-15T17:56:16Z', 'revision_number': 6, 'project_id': '8d7c8a074d704613bf45e1c8d95834e9', 'gw_port_host': None}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:16.671961 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.695735 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Pushing event deleted for resources: {'Port': ['ID=c7c19085-c04e-438d-8d0f-77bd0df3a2d5,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:16.754515 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.862541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.864868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.976473 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.976982 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 74405065-b5c8-4585-a4db-196d01c514b1 {{(pid=108142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:56:16.986550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:16.987577 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c5e33589-ad94-4d68-b40a-1fda1432fdb2 admin admin] 10.222.0.31 "DELETE /v2.0/routers/74405065-b5c8-4585-a4db-196d01c514b1 HTTP/1.1" status: 204 len: 168 time: 0.8601227 Nov 15 17:56:16.995346 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33396) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:17.052056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-9f4dd96d-7822-4b2e-b9b1-52d7a1784df1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:17.053949 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-9f4dd96d-7822-4b2e-b9b1-52d7a1784df1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 808 time: 0.1848993 Nov 15 17:56:17.054094 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Deleting subnet 82578c0d-639e-4df9-bec7-8ae336a8ba92 {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:56:17.057638 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.122292 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c253bb21-9183-4adc-ade1-bb67199cdbf9 req-4be8b5cb-a8d3-4208-8b58-68520f293779 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 210 time: 0.0438240 Nov 15 17:56:17.130018 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.130802 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-3683edcc-1e38-485f-aa13-ff17daec9015 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=418a337f482c4773a787a5a90721966a HTTP/1.1" status: 200 len: 380 time: 0.0658801 Nov 15 17:56:17.140517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'port': {'device_id': '38410a59-5647-49e0-9673-d8b217fe01e8', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'admin_state_up': True, 'tenant_id': '418a337f482c4773a787a5a90721966a', 'security_groups': ['4c4d31bc-10ad-4e45-b360-da275ad788a7']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:17.233426 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.249879 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Made reservation on behalf of 418a337f482c4773a787a5a90721966a for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:17.253386 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.290675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.316033 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=82578c0d-639e-4df9-bec7-8ae336a8ba92,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:17.323741 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.330132 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-ecb93dd5-1261-4bd8-a2cb-c41de006aebf admin admin] 10.222.0.31 "DELETE /v2.0/subnets/82578c0d-639e-4df9-bec7-8ae336a8ba92 HTTP/1.1" status: 204 len: 168 time: 0.3313997 Nov 15 17:56:17.330299 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3148fee4-d0ff-4168-85d4-11f7abe85566 None None] Network 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:56:17.330753 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33400) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:17.392580 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Allocated IP 172.20.0.6 (ea8b085a-8c53-4bf9-a5ac-959d633cd3ec/908418a4-9235-410e-85b3-c01d93461c44/4fed676f-fdcc-4178-b3cb-58ba6e7e9f55) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:17.416672 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.495202 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Deleting port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:17.495533 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.562544 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] For port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:17.562909 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.565830 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] DHCP port deletion for 927b3da0-f3f2-41e8-b00d-4ab5e71093d8 request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:56:17.577576 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Calling delete_port for 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 owned by network:dhcp {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:17.634362 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.643867 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Deleting port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 {{(pid=108143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:56:17.651645 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.671200 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.696610 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device c7c19085-c04e-438d-8d0f-77bd0df3a2d5 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:56:17.702902 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.722149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:17.726517 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:17.726810 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: c7c19085-c04e-438d-8d0f-77bd0df3a2d5 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:56:17.727333 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device c7c19085-c04e-438d-8d0f-77bd0df3a2d5 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:56:17.727965 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:56:17.732052 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:17.754737 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] No DVR routers for this DVR port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 on host dv-cinder-788366-7-iscsi {{(pid=108141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:56:17.761060 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Pushing event deleted for resources: {'Port': ['ID=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:17.766966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:17.783452 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] For port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,segment=NetworkSegment(27f12457-b2da-466e-9e22-d4c08a5b79c1),segment_id=27f12457-b2da-466e-9e22-d4c08a5b79c1)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:17.783645 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.801249 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:56:17.801577 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:56:17.802009 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a8112831-21d6-4674-bd6b-bbb20d57e836 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:56:17.809868 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Calling delete_port for 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 owned by network:dhcp {{(pid=108143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:56:17.811005 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:17.812044 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.846666 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: a8112831-21d6-4674-bd6b-bbb20d57e836 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:56:17.847129 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a8112831-21d6-4674-bd6b-bbb20d57e836 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:56:17.851810 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-146dfd1b-91e2-4847-8f53-ed8e0d2a2db9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7147572 Nov 15 17:56:17.856691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.869074 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Request body: {'port': {'device_id': '38410a59-5647-49e0-9673-d8b217fe01e8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:17.897691 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['927b3da0-f3f2-41e8-b00d-4ab5e71093d8']}} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:17.908344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '27f12457-b2da-466e-9e22-d4c08a5b79c1') {'for_net_delete': True} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:17.908617 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '27f12457-b2da-466e-9e22-d4c08a5b79c1') {} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:17.925507 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59181159'] for segment, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.939926 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.946340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Releasing vlan 447 on physical network physnet1 to pool {{(pid=108141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:56:17.946816 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59170109'] for segment, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: Traceback (most recent call last): Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: timer() Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: cb(*args, **kw) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: return func(*args, **kwargs) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: self._notify() Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: self.callback(batched_events) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: event.method(event) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: return f(self, *a, **k) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._get(url).json() Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: return self.request(url, 'GET', **kwargs) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:56:17.948804 dv-cinder-788366-7-iscsi neutron-server[108141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:56:17.959217 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527'] for port, after_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.982206 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:17.996334 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] No DVR routers for this DVR port 9d9f1b93-fcbf-4976-ab96-eb5423e0d700 on host dv-cinder-788366-7-iscsi {{(pid=108143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:56:18.001213 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Pushing event deleted for resources: {'Port': ['ID=9d9f1b93-fcbf-4976-ab96-eb5423e0d700,revision_number=None']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:18.013878 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.014981 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.016419 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.016825 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.017144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.018185 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.018517 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.019271 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.019271 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.019519 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.019790 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.020110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.020762 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124f5e2c-1b42-44c4-a325-dee220582731 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:18.024136 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.027619 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] 10.222.0.31 "DELETE /v2.0/networks/927b3da0-f3f2-41e8-b00d-4ab5e71093d8 HTTP/1.1" status: 204 len: 168 time: 0.6959591 Nov 15 17:56:18.037697 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d7681a-890b-42fe-a75d-0557d3485a1b admin admin] Pushing event deleted for resources: {'Network': ['ID=927b3da0-f3f2-41e8-b00d-4ab5e71093d8,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:18.070298 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8061033c-438f-41db-a775-ebd892647173 None None] Provisioning complete for port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:18.070745 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8061033c-438f-41db-a775-ebd892647173 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.116565 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-8061033c-438f-41db-a775-ebd892647173 None None] Port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:56:18.156869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33406) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:18.198157 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-87a6fab9-b298-462a-a6b8-9509c095176c admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8d7c8a074d704613bf45e1c8d95834e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0401073 Nov 15 17:56:18.201392 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33408) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:18.263181 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:56:18.270719 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.277433 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0476094-d597-4b54-81bf-c586f99d17e9 req-06cc6e59-0597-480a-a9dc-6ec55cecb8f9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:18.278925 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e0476094-d597-4b54-81bf-c586f99d17e9 req-06cc6e59-0597-480a-a9dc-6ec55cecb8f9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 931 time: 0.0788109 Nov 15 17:56:18.284156 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Transition to ACTIVE for port object 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:56:18.290380 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.303201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.335014 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.345881 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:18.373396 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e0476094-d597-4b54-81bf-c586f99d17e9 req-6975c975-84b3-40ee-bd8a-04ee1b5b5dc4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0861757 Nov 15 17:56:18.417454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Attempting to bind port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:18.417777 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Attempting to bind port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:18.418154 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Attempting to bind port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 on network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:18.418909 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.422224 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.422764 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 on network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:56:18.423092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Attempting to bind port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 on network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:18.424269 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4f847ccb-7395-4d8e-9932-0fe0c352ee71 HTTP/1.1" status: 204 len: 168 time: 0.2218728 Nov 15 17:56:18.430147 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 55, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:18.430557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Checking segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:18.430948 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Bound using segment: {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:18.431390 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Bound port: 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 437, 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:18.431771 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.440804 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8ebf0ac-91a6-4adc-a71b-59475ceec52d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f847ccb-7395-4d8e-9932-0fe0c352ee71,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:18.503405 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:18.507013 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:18.512321 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.555535 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:18.556189 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:18.557480 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] 10.222.0.48 "PUT /v2.0/ports/4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 1093 time: 0.6966403 Nov 15 17:56:18.557936 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:56:18.560208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5" -d '{"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:56:18.600910 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d0ad9e-5324-4071-8bb6-b9cbf0945627 service neutron] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:18.606306 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:56:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc229352-b1da-4ba5-975a-1e7578f992a9 x-openstack-request-id: req-bc229352-b1da-4ba5-975a-1e7578f992a9 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:56:18.606653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:56:18.606899 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-bc229352-b1da-4ba5-975a-1e7578f992a9 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:56:18.608018 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'status': 'completed', 'code': 200} Nov 15 17:56:18.657113 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-e6fbeb71-6533-46c9-8dd6-4e765aa89a87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:18.658614 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-e6fbeb71-6533-46c9-8dd6-4e765aa89a87 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1096 time: 0.0460191 Nov 15 17:56:18.705068 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-19376eb1-faf2-4bdb-bed9-7e07596577ad service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 217 time: 0.0357928 Nov 15 17:56:19.020149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-8a2286be-dd75-460d-9ce6-d76b84d0399f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.021611 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-8a2286be-dd75-460d-9ce6-d76b84d0399f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.3090749 Nov 15 17:56:19.068369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-2aceb347-43de-4aa4-a741-9e64e48aada0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.070035 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-2aceb347-43de-4aa4-a741-9e64e48aada0 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391440 Nov 15 17:56:19.163040 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-5cde863e-2c3c-4ada-a60b-51efaed586e8 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854268 Nov 15 17:56:19.254760 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-2aef5f43-1225-4c2e-a748-597502a56f4b req-35131468-ccf2-42db-8b5c-84cc00b86af9 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846295 Nov 15 17:56:19.347134 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-351ddffb-bca2-4b9a-8bed-8159def1c2ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.348673 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-351ddffb-bca2-4b9a-8bed-8159def1c2ab service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1096 time: 0.0402050 Nov 15 17:56:19.452342 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-c83f2dd3-6114-4a4f-a425-232c93fd714d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.454716 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-c83f2dd3-6114-4a4f-a425-232c93fd714d service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.0982168 Nov 15 17:56:19.498017 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-b573a579-5fc6-4276-aa9e-dadbaa4886fd service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 217 time: 0.0358534 Nov 15 17:56:19.512728 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8ce3b9-438c-423e-b4cb-a12e6425bfb0 req-d4ef3354-1752-435f-a4da-c45958414b04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.514945 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1c8ce3b9-438c-423e-b4cb-a12e6425bfb0 req-d4ef3354-1752-435f-a4da-c45958414b04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0577180 Nov 15 17:56:19.565511 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-7784a01a-4414-41f3-b3e2-1d5b027348c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.567086 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-7784a01a-4414-41f3-b3e2-1d5b027348c0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0623808 Nov 15 17:56:19.567278 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1c8ce3b9-438c-423e-b4cb-a12e6425bfb0 req-049e004a-110a-4f46-bfea-57674df1bb4c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447805 Nov 15 17:56:19.621133 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-d9e641f2-b34a-4023-ade1-fd9adb53e895 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:19.622535 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-d9e641f2-b34a-4023-ade1-fd9adb53e895 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0467334 Nov 15 17:56:19.717412 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-42d03083-6cbb-4dfd-aae2-02c419db2f52 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869977 Nov 15 17:56:19.814601 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9e38a584-a8ec-4bb6-87a1-b24e887c0bd5 req-d40a700e-09db-4271-bbfb-ae0e396eb7d2 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889268 Nov 15 17:56:20.705149 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf772276-8403-4341-b8b9-3778b88d106b req-542bbe46-742a-4f91-b40a-246ea230f6eb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:20.706719 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cf772276-8403-4341-b8b9-3778b88d106b req-542bbe46-742a-4f91-b40a-246ea230f6eb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0562353 Nov 15 17:56:20.758937 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cf772276-8403-4341-b8b9-3778b88d106b req-c5c51229-ad35-4ff1-9968-0da05bbe9f8b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461061 Nov 15 17:56:21.897376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71a0119-3b72-48e1-a7ac-c6441aa8d2e0 req-897256f1-589f-4cfb-8268-238bcbf1caa9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:21.899029 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f71a0119-3b72-48e1-a7ac-c6441aa8d2e0 req-897256f1-589f-4cfb-8268-238bcbf1caa9 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0630577 Nov 15 17:56:21.951988 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f71a0119-3b72-48e1-a7ac-c6441aa8d2e0 req-f1f2fcbb-3b87-491e-878a-2537d8dba689 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460372 Nov 15 17:56:22.391451 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:23.082690 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338f8104-7f39-4850-a40f-8749e2534b06 req-5389d55c-5241-42dc-8170-8db12908a460 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:23.084176 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-338f8104-7f39-4850-a40f-8749e2534b06 req-5389d55c-5241-42dc-8170-8db12908a460 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0530932 Nov 15 17:56:23.139001 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-338f8104-7f39-4850-a40f-8749e2534b06 req-1aa3d4b7-8b88-4c4b-aeb0-e7adbc04d6e1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454118 Nov 15 17:56:24.278272 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f959644-d609-477b-bd83-e5bd091c43b3 req-8609f406-ace8-4396-a832-0f714dafdcaa tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:24.280026 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f959644-d609-477b-bd83-e5bd091c43b3 req-8609f406-ace8-4396-a832-0f714dafdcaa tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0671873 Nov 15 17:56:24.334418 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f959644-d609-477b-bd83-e5bd091c43b3 req-a165d880-31b2-47df-abd6-822536c84985 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480623 Nov 15 17:56:25.464787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9488fa52-20a5-4991-abea-e92ac992d4bd req-95a5b86a-31c4-4cae-8f2f-4d87891d07c3 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:25.466921 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9488fa52-20a5-4991-abea-e92ac992d4bd req-95a5b86a-31c4-4cae-8f2f-4d87891d07c3 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0590813 Nov 15 17:56:25.527542 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9488fa52-20a5-4991-abea-e92ac992d4bd req-0cb674af-02ce-4016-8fc8-83a85b4874c3 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542915 Nov 15 17:56:26.652583 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18717baf-4d60-460b-b0bc-7b96d4ddff34 req-6e70ed0c-085b-4735-bd71-bc4306f8c8e6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:26.659841 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18717baf-4d60-460b-b0bc-7b96d4ddff34 req-6e70ed0c-085b-4735-bd71-bc4306f8c8e6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0584249 Nov 15 17:56:26.705858 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-18717baf-4d60-460b-b0bc-7b96d4ddff34 req-c322cc75-1695-478e-8ecc-cd311838a942 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451441 Nov 15 17:56:26.884619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33536) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:26.997752 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2310cd97-9474-49eb-8638-4364f98c8cb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.073102 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2310cd97-9474-49eb-8638-4364f98c8cb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.078519 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-2310cd97-9474-49eb-8638-4364f98c8cb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.115926 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-2310cd97-9474-49eb-8638-4364f98c8cb0 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=71f7194475ec42fc809bf29a63c404c3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2301588 Nov 15 17:56:27.117020 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2310cd97-9474-49eb-8638-4364f98c8cb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea13af5e-496b-49c9-b6ff-948a8055334f,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:27.119628 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33540) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:27.170247 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.191004 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.240979 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.243598 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.245364 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ea13af5e-496b-49c9-b6ff-948a8055334f HTTP/1.1" status: 204 len: 168 time: 0.1255524 Nov 15 17:56:27.253491 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b7c97b-e9b1-4e4b-b437-152fe81b4def admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea13af5e-496b-49c9-b6ff-948a8055334f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:27.611114 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:56:27.708199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:27.720870 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'mac_address': 'fa:16:3e:14:56:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 437, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:56:27.764118 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.777944 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:56:27.800348 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:27.805426 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:27.860383 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:28.016703 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:56:28.077062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae380425-575d-44ea-b5ec-21d0fe566932 req-eea65bb5-51d6-4764-be14-a04f8e97dd57 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:28.078783 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ae380425-575d-44ea-b5ec-21d0fe566932 req-eea65bb5-51d6-4764-be14-a04f8e97dd57 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.2999485 Nov 15 17:56:28.129957 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-ae380425-575d-44ea-b5ec-21d0fe566932 req-19ed5f72-be53-4022-bf82-10eedf0c9a59 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445056 Nov 15 17:56:28.904757 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33588) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:29.023789 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7fea6263-136e-4bdc-926b-b89986003e44 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.100056 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7fea6263-136e-4bdc-926b-b89986003e44 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.106068 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7fea6263-136e-4bdc-926b-b89986003e44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.144728 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7fea6263-136e-4bdc-926b-b89986003e44 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=1ff484e4eaf545c78f03fdb676c9cd68&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2388706 Nov 15 17:56:29.145565 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fea6263-136e-4bdc-926b-b89986003e44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cf46a75-381b-411f-b93b-1972f290a972,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:29.148317 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33592) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:29.201162 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.223039 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.252200 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58bbc27b-d871-4ffa-b68d-095264617253 req-86f524a2-c3b2-4405-af34-3b2bbf0d1a93 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:29.253654 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-58bbc27b-d871-4ffa-b68d-095264617253 req-86f524a2-c3b2-4405-af34-3b2bbf0d1a93 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 944 time: 0.0526354 Nov 15 17:56:29.270866 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.273598 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.274762 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1cf46a75-381b-411f-b93b-1972f290a972 HTTP/1.1" status: 204 len: 168 time: 0.1252768 Nov 15 17:56:29.282661 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b0db38-0d4a-4e07-9e79-1b6bf02d760b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cf46a75-381b-411f-b93b-1972f290a972,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:29.307335 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-58bbc27b-d871-4ffa-b68d-095264617253 req-84057d53-2955-45e8-bdd2-a3895f670118 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476022 Nov 15 17:56:29.558954 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33600) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:29.572205 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-216ae81f-05f8-427f-ad92-e33a1edab942 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.615423 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:29.647310 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-216ae81f-05f8-427f-ad92-e33a1edab942 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.651667 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-216ae81f-05f8-427f-ad92-e33a1edab942 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.669819 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:56:29.674019 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:29.674383 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.690144 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-216ae81f-05f8-427f-ad92-e33a1edab942 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2dd4efe98e9f4e56a0727ac4cf2cefd2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1300752 Nov 15 17:56:29.690942 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216ae81f-05f8-427f-ad92-e33a1edab942 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87a054b1-4fdf-4051-8ff6-11068cefe525,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:29.693976 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33602) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:29.743312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.752430 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.764576 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.774554 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:56:29.777060 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fede85d3-63c1-4ae8-9a5d-6bb457ded7e8" -d '{"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-plugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:56:29.790364 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:29.800620 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.814013 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.817877 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:29.820153 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/87a054b1-4fdf-4051-8ff6-11068cefe525 HTTP/1.1" status: 204 len: 168 time: 0.1260226 Nov 15 17:56:29.828090 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:56:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d8f4909-9a5a-441a-9929-d9d1c00ef9f6 x-openstack-request-id: req-1d8f4909-9a5a-441a-9929-d9d1c00ef9f6 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:56:29.828367 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-plugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:56:29.828809 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1d8f4909-9a5a-441a-9929-d9d1c00ef9f6 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:56:29.829343 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'code': 200} Nov 15 17:56:29.837613 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e82c567-c300-4a0e-9cdd-40eb69af91cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87a054b1-4fdf-4051-8ff6-11068cefe525,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:29.867154 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:30.037971 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f2811c-0eb8-46a6-835f-bb3ffd50d162 req-9e64ed4d-0ee7-407d-a49a-e2b649a94130 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:30.039618 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d9f2811c-0eb8-46a6-835f-bb3ffd50d162 req-9e64ed4d-0ee7-407d-a49a-e2b649a94130 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0428100 Nov 15 17:56:30.085989 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d9f2811c-0eb8-46a6-835f-bb3ffd50d162 req-dbfdde35-fd68-4c60-aa94-1d4fe70d4b24 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387876 Nov 15 17:56:30.425811 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09bf05f-536f-4b72-a464-6d1bf4504e77 req-ac780d99-23c9-445b-aa89-3c590d065402 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:30.427413 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d09bf05f-536f-4b72-a464-6d1bf4504e77 req-ac780d99-23c9-445b-aa89-3c590d065402 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0492537 Nov 15 17:56:30.482749 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d09bf05f-536f-4b72-a464-6d1bf4504e77 req-8dc5cce0-b58b-4bdd-a7df-cdd4cbc59469 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483227 Nov 15 17:56:30.795045 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-15097f65-7327-4297-b003-b03b56581c16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:31.600463 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf81cc7-fb78-43d6-a089-2b26ba7f979c req-a390ccc0-799f-40ca-924d-0e6ddafd72ec tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:31.602010 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cdf81cc7-fb78-43d6-a089-2b26ba7f979c req-a390ccc0-799f-40ca-924d-0e6ddafd72ec tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0495803 Nov 15 17:56:31.657280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cdf81cc7-fb78-43d6-a089-2b26ba7f979c req-52fd31e0-1b32-434e-8564-2370a00c08c5 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488341 Nov 15 17:56:31.773618 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e8b6480-5d25-4d2d-9abc-fe841b9a6a94 req-9b91349f-c568-44c5-b2fc-a499e233d6ff tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:31.775109 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5e8b6480-5d25-4d2d-9abc-fe841b9a6a94 req-9b91349f-c568-44c5-b2fc-a499e233d6ff tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0500937 Nov 15 17:56:31.825592 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5e8b6480-5d25-4d2d-9abc-fe841b9a6a94 req-7253ef8e-cc10-475a-8980-cf62d222b0a7 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440326 Nov 15 17:56:31.848205 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33664) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:32.043330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26474e58-d88d-437c-9db3-fdd4a96fb0f5 tempest-TestShelveInstance-799004122 tempest-TestShelveInstance-799004122-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:32.044898 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-26474e58-d88d-437c-9db3-fdd4a96fb0f5 tempest-TestShelveInstance-799004122 tempest-TestShelveInstance-799004122-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1093 time: 0.1954441 Nov 15 17:56:32.049041 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33668) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:32.053296 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'fixed_ip_address': '172.20.0.6'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:32.076744 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for floatingip, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:32.187642 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:32.295996 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Allocated IP 172.27.0.184 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/c3252657-2a44-46ed-b456-0dd1fa625844) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:32.399297 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:32.436452 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:32.477447 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:32.480539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:32.483157 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:32.488779 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'Port': ['ID=c3252657-2a44-46ed-b456-0dd1fa625844,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:32.836683 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:32.906563 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.068786 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.074336 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.099751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-30b92218-9e6c-4d9d-bb66-0bad7ab24d04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.147764 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event updated for resources: {'Port': ['ID=c3252657-2a44-46ed-b456-0dd1fa625844,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:33.156042 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.268282 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Floating IP 901e012e-e439-4b8b-be78-8180527670cc associated. External IP: 172.27.0.184, port: 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55. Nov 15 17:56:33.499666 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Router 705e06c1-9692-44f5-9f70-49c868ee876e has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:56:33.607630 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:33.618127 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Sync routers for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:33.628573 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:33.629298 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:33.629921 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:33.659343 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-12ed5e8b-c75e-4a04-84da-b0ea6ed63c37 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.6093130 Nov 15 17:56:33.660404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:56:33.663748 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7372e478-d9ac-46f3-8c96-1844d0cd248b" -d '{"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:56:33.700791 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:56:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb425b71-3737-44f8-8706-23ebf5a54af8 x-openstack-request-id: req-cb425b71-3737-44f8-8706-23ebf5a54af8 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:56:33.701149 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:56:33.701457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-cb425b71-3737-44f8-8706-23ebf5a54af8 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:56:33.701911 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'status': 'completed', 'code': 200} Nov 15 17:56:33.774057 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-2a93c3f8-030e-467c-9408-cf87a2a126e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:33.775510 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-2a93c3f8-030e-467c-9408-cf87a2a126e9 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0483243 Nov 15 17:56:33.872368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-a9fa0f1a-c576-4442-8b63-aeaf3c0a1275 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:33.873909 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-a9fa0f1a-c576-4442-8b63-aeaf3c0a1275 service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.0890455 Nov 15 17:56:33.882516 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:33.946597 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-a1201ab4-f519-40cd-8197-f5f8ea6dd25c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 999 time: 0.0625772 Nov 15 17:56:34.002866 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-511c21ad-6bfe-40db-a74b-876d70f096d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:34.004402 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-511c21ad-6bfe-40db-a74b-876d70f096d7 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0471547 Nov 15 17:56:34.050225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-ad85e9cc-3505-4680-a70c-efdf4e707bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:34.051949 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-ad85e9cc-3505-4680-a70c-efdf4e707bc4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400698 Nov 15 17:56:34.112535 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '901e012e-e439-4b8b-be78-8180527670cc', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'floating_ip_address': '172.27.0.184', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'mac_address': 'fa:16:3e:14:56:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38410a59-5647-49e0-9673-d8b217fe01e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:56:32Z', 'updated_at': '2021-11-15T17:56:32Z', 'revision_number': 0, 'project_id': '418a337f482c4773a787a5a90721966a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:34.145821 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Checking router: 705e06c1-9692-44f5-9f70-49c868ee876e for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:34.154802 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:34.155473 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:34.164685 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-7578d4a9-e38e-441f-98b2-bc5ea832678f service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1039715 Nov 15 17:56:34.214191 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33694) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:34.261166 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7372e478-d9ac-46f3-8c96-1844d0cd248b req-ec4e1c0a-674f-4d16-823b-c05cac5a5861 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885308 Nov 15 17:56:34.261676 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:34.322663 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-edac61a5-a972-4b46-921f-f39d7f69a12a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.397857 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-edac61a5-a972-4b46-921f-f39d7f69a12a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.402449 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-edac61a5-a972-4b46-921f-f39d7f69a12a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.441292 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-edac61a5-a972-4b46-921f-f39d7f69a12a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ab1f462a27954e6a939f1569463766ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2259974 Nov 15 17:56:34.442408 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edac61a5-a972-4b46-921f-f39d7f69a12a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c5e3b16-74ab-4a41-9a46-d294c31c01e1,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:34.445041 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33698) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:34.485389 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.499984 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '901e012e-e439-4b8b-be78-8180527670cc', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'floating_ip_address': '172.27.0.184', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'mac_address': 'fa:16:3e:14:56:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38410a59-5647-49e0-9673-d8b217fe01e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:56:32Z', 'updated_at': '2021-11-15T17:56:32Z', 'revision_number': 0, 'project_id': '418a337f482c4773a787a5a90721966a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:34.503561 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.524599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.529996 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a8821f7-bb77-44a2-b134-cc0357608bc4 None None] The sync data for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi is: [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '901e012e-e439-4b8b-be78-8180527670cc', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'floating_ip_address': '172.27.0.184', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'mac_address': 'fa:16:3e:14:56:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38410a59-5647-49e0-9673-d8b217fe01e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:56:32Z', 'updated_at': '2021-11-15T17:56:32Z', 'revision_number': 0, 'project_id': '418a337f482c4773a787a5a90721966a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:34.573223 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.576236 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.577381 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/3c5e3b16-74ab-4a41-9a46-d294c31c01e1 HTTP/1.1" status: 204 len: 168 time: 0.1307013 Nov 15 17:56:34.585175 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52909d8a-be00-4e20-9a2a-87c9984c8204 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c5e3b16-74ab-4a41-9a46-d294c31c01e1,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:34.741707 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78329a02-6314-4ce4-92cd-42134de30d6d None None] New status for floating IP 901e012e-e439-4b8b-be78-8180527670cc: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:56:34.855306 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33704) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:34.868752 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8db95e1-f53b-4982-beef-20895a51e0c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.945643 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8db95e1-f53b-4982-beef-20895a51e0c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.952282 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8db95e1-f53b-4982-beef-20895a51e0c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:34.987689 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8db95e1-f53b-4982-beef-20895a51e0c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7cef309-4398-4270-9058-a7cc9e90f97f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:34.992315 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c8db95e1-f53b-4982-beef-20895a51e0c2 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c6356c5a50ce42ac9ce89fbba395bd0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1357474 Nov 15 17:56:34.994870 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33706) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:35.043754 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:35.076037 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:35.128970 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:35.131692 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:35.133193 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d7cef309-4398-4270-9058-a7cc9e90f97f HTTP/1.1" status: 204 len: 168 time: 0.1374152 Nov 15 17:56:35.141153 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a304c2-e0c6-4011-9d19-3b6386fb264d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7cef309-4398-4270-9058-a7cc9e90f97f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:35.595145 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:36.669309 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:36.985424 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33762) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:37.095239 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7606884f-9faf-4ffa-bcd8-73fe2ef4c9ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.171312 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7606884f-9faf-4ffa-bcd8-73fe2ef4c9ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.176116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7606884f-9faf-4ffa-bcd8-73fe2ef4c9ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.213244 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7606884f-9faf-4ffa-bcd8-73fe2ef4c9ae admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=12a2ca6b941747658d48e9e3a95f5cee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2267373 Nov 15 17:56:37.214202 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7606884f-9faf-4ffa-bcd8-73fe2ef4c9ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acddf2f9-ad49-4855-bfc2-a926517e1f38,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:37.216898 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33766) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:37.268020 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.298753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.351462 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.354103 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.355250 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/acddf2f9-ad49-4855-bfc2-a926517e1f38 HTTP/1.1" status: 204 len: 168 time: 0.1373882 Nov 15 17:56:37.363151 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2de38783-ca41-47bf-98fd-bce6772b4637 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acddf2f9-ad49-4855-bfc2-a926517e1f38,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:37.628981 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33772) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:37.642480 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-37c4f2fe-aa26-4c92-af89-c533d83f5182 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.715747 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-37c4f2fe-aa26-4c92-af89-c533d83f5182 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.721925 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-37c4f2fe-aa26-4c92-af89-c533d83f5182 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.759825 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-37c4f2fe-aa26-4c92-af89-c533d83f5182 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c514fc26e05b44af95af78626af1715b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1297204 Nov 15 17:56:37.760750 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c4f2fe-aa26-4c92-af89-c533d83f5182 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26b8a96f-9853-49db-80ce-ae86d2c4bd8e,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:37.762751 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33774) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:37.815419 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.838285 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.890247 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.892903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:37.894050 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/26b8a96f-9853-49db-80ce-ae86d2c4bd8e HTTP/1.1" status: 204 len: 168 time: 0.1301491 Nov 15 17:56:37.901894 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebcb670-5534-4403-98d1-99356bb04e43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26b8a96f-9853-49db-80ce-ae86d2c4bd8e,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:38.623783 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33796) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:38.727332 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-553874745-network', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:38.752291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Made reservation on behalf of 6178223d48944b6ba503c95dcdaa1089 for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:38.755051 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.766031 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.858328 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.865489 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.892296 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] vlan segment allocate from pool success with {'vlan_id': 411, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:56:38.901910 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5aea9168-36ea-4859-8653-eac99ba3fb1f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:38.907122 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.907460 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Added segment 42b749ed-dfd6-4403-8018-6ac2558cada8 of type vlan for network c79add16-3f72-42fd-a9c3-e0a2bf5f312f Nov 15 17:56:38.945932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.972378 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:38.973363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:38.973937 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.023283 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3980470 Nov 15 17:56:39.026502 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33800) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:39.032116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Request body: {'subnet': {'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-553874745-subnet', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:39.034022 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e181bc9-697e-42e9-9639-5163ab0e0ae9 admin admin] Pushing event updated for resources: {'Network': ['ID=c79add16-3f72-42fd-a9c3-e0a2bf5f312f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:39.045225 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:56:39.056302 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Made reservation on behalf of 6178223d48944b6ba503c95dcdaa1089 for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:39.058891 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-59344358'] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.230264 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59170246', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-59344372'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.279552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=775e7c93-5715-4404-bdb1-411ccedb6a65,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:39.300963 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Checking segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:39.301420 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Network hostable DHCP agents. Network: c79add16-3f72-42fd-a9c3-e0a2bf5f312f, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:56:39.323269 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:56:39.334624 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, c79add16-3f72-42fd-a9c3-e0a2bf5f312f) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:39.338975 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:39.339581 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.343915 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-040fea02-c529-4602-9977-28c0a7d5029f None None] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:56:39.358625 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-e93b6559-cd31-4bbd-a3c4-3d8f0c0594c4 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3282545 Nov 15 17:56:39.359165 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33802) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:39.363796 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:39.385477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.386483 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.438929 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.485531 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:56:39.486394 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.573353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.616282 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Allocated IP 172.20.0.2 (c79add16-3f72-42fd-a9c3-e0a2bf5f312f/775e7c93-5715-4404-bdb1-411ccedb6a65/08e74965-3d1d-4d27-9ac6-fac600ec00d1) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:39.761487 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.769003 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.816711 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:39.820813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:39.823533 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:39.826092 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Pushing event updated for resources: {'Port': ['ID=08e74965-3d1d-4d27-9ac6-fac600ec00d1,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:39.883109 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Attempting to bind port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:39.883485 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Attempting to bind port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:39.883877 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Attempting to bind port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 on network c79add16-3f72-42fd-a9c3-e0a2bf5f312f {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:39.890188 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:39.890801 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Checking segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:39.891253 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.891674 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Bound using segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:39.893085 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Bound port: 08e74965-3d1d-4d27-9ac6-fac600ec00d1, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:39.893495 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:39.963716 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] For port 08e74965-3d1d-4d27-9ac6-fac600ec00d1, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:39.967370 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] For port 08e74965-3d1d-4d27-9ac6-fac600ec00d1, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=08e74965-3d1d-4d27-9ac6-fac600ec00d1,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:39.972781 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.029080 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d461b108-9bbe-4853-98f1-55bf5f5aad92 None None] Pushing event updated for resources: {'Port': ['ID=08e74965-3d1d-4d27-9ac6-fac600ec00d1,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:40.037256 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.056337 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.171939 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Allocated IP 172.27.0.153 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:40.302160 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.335385 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.376692 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:40.379572 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:40.383178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:40.404070 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Pushing event updated for resources: {'Port': ['ID=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:40.644358 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.844321 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:40.888894 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-056a8c57-cebd-45c6-a94f-728547e65c4f None None] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:56:40.972018 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Router 584aa81d-01fd-4562-8c25-b74e291f924b is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:56:41.001971 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] Provisioning complete for port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:41.002352 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.070515 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:41.088855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.090121 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a3fdbd41-07e8-434c-a686-5f8944ce278b admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.7297986 Nov 15 17:56:41.092841 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33810) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:41.097634 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Sync routers for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:41.135889 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:41.136525 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:41.174241 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.385616 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] For port 08e74965-3d1d-4d27-9ac6-fac600ec00d1, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=08e74965-3d1d-4d27-9ac6-fac600ec00d1,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:41.390814 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.431635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:41.510633 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e512ad00-8b4a-4746-a0b3-ae227fe2b17e None None] Pushing event updated for resources: {'Port': ['ID=08e74965-3d1d-4d27-9ac6-fac600ec00d1,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:41.526663 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.561382 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-623fd571-a33d-481f-adfd-cf67a8e8e482 None None] Provisioning complete for port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:41.561751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-623fd571-a33d-481f-adfd-cf67a8e8e482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.672093 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 08e74965-3d1d-4d27-9ac6-fac600ec00d1 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:41.690695 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Allocated IP 172.20.0.1 (c79add16-3f72-42fd-a9c3-e0a2bf5f312f/775e7c93-5715-4404-bdb1-411ccedb6a65/b62383e4-d9b3-418e-88f9-01eec51d2fe7) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:41.748856 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:40Z', 'revision_number': 3, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:41.752347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:41.752709 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.777718 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Checking router: 584aa81d-01fd-4562-8c25-b74e291f924b for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:41.778059 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Updating router 584aa81d-01fd-4562-8c25-b74e291f924b port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:56:41.793303 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.826087 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.830140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:41.871758 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:41.874775 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:41.877344 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:41.910399 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Pushing event updated for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:41.928980 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.056118 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.125355 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.131964 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.194888 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-139756cc-7d25-4dc3-a765-76b01c54c55e None None] Provisioning complete for port b62383e4-d9b3-418e-88f9-01eec51d2fe7 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:42.195251 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-139756cc-7d25-4dc3-a765-76b01c54c55e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.196721 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce27b13-615b-42b5-a321-bf05fd02b64e None None] Pushing event updated for resources: {'Port': ['ID=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:42.198908 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Attempting to bind port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:42.199269 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Attempting to bind port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:42.199809 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Attempting to bind port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:42.216773 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.222163 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.226354 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:42.226747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:42.227116 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.227501 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:42.228010 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Bound port: a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:42.228376 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.266287 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-139756cc-7d25-4dc3-a765-76b01c54c55e None None] Port b62383e4-d9b3-418e-88f9-01eec51d2fe7 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:56:42.287598 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] For port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:42.288278 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Pushing event updated for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:42.290894 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] For port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:42.291990 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.295956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.350117 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:42.350726 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:42.387309 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:42.389286 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:42.412091 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce27b13-615b-42b5-a321-bf05fd02b64e None None] Pushing event updated for resources: {'Port': ['ID=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:42.463502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:42.502269 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Router 584aa81d-01fd-4562-8c25-b74e291f924b has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:56:42.606758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-df14adf2-ef62-4d9a-85ff-4e37f6cc4508 None None] Provisioning complete for port b62383e4-d9b3-418e-88f9-01eec51d2fe7 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:42.607118 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-df14adf2-ef62-4d9a-85ff-4e37f6cc4508 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:42.608664 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:42.613667 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-5db1b76b-20ee-4b1f-a55d-8a0735ca5bcf admin admin] 10.222.0.31 "PUT /v2.0/routers/584aa81d-01fd-4562-8c25-b74e291f924b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5197189 Nov 15 17:56:42.688896 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-df14adf2-ef62-4d9a-85ff-4e37f6cc4508 None None] Port b62383e4-d9b3-418e-88f9-01eec51d2fe7 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:56:42.717621 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 2, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:42.744776 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ecff0ef-0f2b-441d-9ef7-1cf4aea0ca3c None None] The sync data for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi is: [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 2, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:43.121317 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 33826) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:43.126527 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-852369918-network', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:43.149556 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Made reservation on behalf of c816ff326bb64f309cd66657d7f76bb1 for: {'network': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:43.151963 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for network, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.161377 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.240904 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.249978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.269398 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] vlan segment allocate from pool success with {'vlan_id': 443, 'physical_network': 'physnet1'} {{(pid=108142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 17:56:43.287181 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb11f364-b0de-48ad-b99c-d6119d47f6eb,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:43.293364 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.293364 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.segments_db [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Added segment f0ca50e6-67a1-4c41-a0b4-6a2751838480 of type vlan for network 3e6e03e1-f7bd-45ef-801e-102163545fa4 Nov 15 17:56:43.345886 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762238360324'] for network, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.374430 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206'] for network, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.375760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:43.376363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.435036 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3125443 Nov 15 17:56:43.437870 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33828) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:43.438732 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3791155-0991-4af1-8caa-9d5eb5a6ba3b admin admin] Pushing event updated for resources: {'Network': ['ID=3e6e03e1-f7bd-45ef-801e-102163545fa4,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:43.444849 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Request body: {'subnet': {'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-852369918-subnet', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'ip_version': 4}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:43.449591 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 details requested by agent ovs-agent-dv-cinder-788366-7-iscsi with host dv-cinder-788366-7-iscsi {{(pid=108143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 17:56:43.471141 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Made reservation on behalf of c816ff326bb64f309cd66657d7f76bb1 for: {'subnet': 1} {{(pid=108141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:43.473630 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-59344358'] for subnet, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.645950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:43.657864 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-59170246', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-59344372'] for subnet, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.704735 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:43.705107 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.718720 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Pushing event updated for resources: {'Subnet': ['ID=13d7214d-dca8-4983-8a11-153b45bde2ef,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:43.727980 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Checking segment: {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:43.728336 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Network hostable DHCP agents. Network: 3e6e03e1-f7bd-45ef-801e-102163545fa4, hostable agents: ['a8dc439a-32d7-4d98-9638-bbe0d704f8ad'], hosted agents: [] {{(pid=108141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 17:56:43.750717 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 is scheduled to be hosted by DHCP agent a8dc439a-32d7-4d98-9638-bbe0d704f8ad with binding_index 1 {{(pid=108141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 17:56:43.763033 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-788366-7-iscsi, 3e6e03e1-f7bd-45ef-801e-102163545fa4) {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:43.767787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:43.768436 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.785820 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c809aa3e-cdef-4b53-84e5-5f131086794b None None] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:56:43.790588 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0574984a-6bb5-4c58-9c3a-2320695e129e admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3483691 Nov 15 17:56:43.791386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33830) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:43.796069 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:43.819210 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3755831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15634'] for router, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.820404 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3755867', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3753932', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3921329', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-737'] for router, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.845689 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.876415 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:43.880733 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:43.887190 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.035628 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.111647 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:44.147347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6aebccc1-0cb3-5285-ae62-470bdf1ce00f-3e6e03e1-f7bd-45ef-801e-102163545fa4', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef'}]}} from dv-cinder-788366-7-iscsi. {{(pid=108143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 17:56:44.148322 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.244265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.263316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.281169 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.db_base_plugin_common [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Allocated IP 172.20.0.2 (3e6e03e1-f7bd-45ef-801e-102163545fa4/13d7214d-dca8-4983-8a11-153b45bde2ef/22e5dde0-ff30-45e4-8c36-5713ab3df45d) {{(pid=108143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:44.369898 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Allocated IP 172.27.0.17 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/32f3317a-35cc-4d86-b95b-9deb35b0ca6d) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:44.426814 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks [] for port, precommit_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.435979 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518'] for port, after_create {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.473969 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 is already hosted by enough agents. {{(pid=108143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:44.476564 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.478217 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.scheduler.base_scheduler [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Resources bound (agent type, host, resource id): {{(pid=108143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:44.481623 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Received port after_create {{(pid=108143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:44.499352 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Pushing event updated for resources: {'Port': ['ID=22e5dde0-ff30-45e4-8c36-5713ab3df45d,revision_number=1']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:44.511369 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.545885 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Attempting to bind port 22e5dde0-ff30-45e4-8c36-5713ab3df45d on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:44.546775 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Attempting to bind port 22e5dde0-ff30-45e4-8c36-5713ab3df45d by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:44.547138 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Attempting to bind port 22e5dde0-ff30-45e4-8c36-5713ab3df45d on network 3e6e03e1-f7bd-45ef-801e-102163545fa4 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:44.551602 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:44.552431 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:44.552798 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Checking segment: {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:44.553192 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.553574 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Bound using segment: {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:44.554032 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Bound port: 22e5dde0-ff30-45e4-8c36-5713ab3df45d, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:44.554401 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.556509 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:44.560102 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:44.587504 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Pushing event updated for resources: {'Port': ['ID=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:44.621705 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] For port 22e5dde0-ff30-45e4-8c36-5713ab3df45d, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:44.625199 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] For port 22e5dde0-ff30-45e4-8c36-5713ab3df45d, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=22e5dde0-ff30-45e4-8c36-5713ab3df45d,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:44.629845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.693470 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c54fa05-75cd-4652-bcb5-f9513049b620 None None] Pushing event updated for resources: {'Port': ['ID=22e5dde0-ff30-45e4-8c36-5713ab3df45d,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:44.773139 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Sync routers for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:44.784177 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:44.784791 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:44.821184 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:44.912022 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:45.046562 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3755842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3753747'] for router, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.063397 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:56:45.126869 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 2, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:45.153526 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Checking router: 584aa81d-01fd-4562-8c25-b74e291f924b for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:45.153878 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Updating router 584aa81d-01fd-4562-8c25-b74e291f924b port b62383e4-d9b3-418e-88f9-01eec51d2fe7 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:56:45.175969 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Router 5c9ae027-a7b7-41f2-ab49-9c358b6610db is scheduled to L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d with binding_index 1 {{(pid=108141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 17:56:45.181508 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.276110 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:45.287335 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Sync routers for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:45.299002 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.300597 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-feef26ad-2928-4d32-8980-8fca21b80035 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 1.5087950 Nov 15 17:56:45.302326 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:45.303169 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:45.303480 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 33832) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:56:45.426142 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:45.549501 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.561306 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.608699 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aad9ff6-7991-463f-8dc8-d1b8e024cd95 None None] Pushing event updated for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:45.666293 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:44Z', 'revision_number': 3, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:45.688666 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Attempting to bind port b62383e4-d9b3-418e-88f9-01eec51d2fe7 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:45.689406 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Attempting to bind port b62383e4-d9b3-418e-88f9-01eec51d2fe7 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:45.690225 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Attempting to bind port b62383e4-d9b3-418e-88f9-01eec51d2fe7 on network c79add16-3f72-42fd-a9c3-e0a2bf5f312f {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:45.697857 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:45.698608 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Checking segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:45.699244 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.700411 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Bound using segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:45.701242 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Bound port: b62383e4-d9b3-418e-88f9-01eec51d2fe7, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:45.701960 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.734779 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Checking router: 5c9ae027-a7b7-41f2-ab49-9c358b6610db for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:45.735502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Updating router 5c9ae027-a7b7-41f2-ab49-9c358b6610db port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d binding host dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:56:45.773604 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] For port b62383e4-d9b3-418e-88f9-01eec51d2fe7, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:45.774690 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d1e7b76-0fc7-4c1a-8295-16f6a5429b13 None None] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:56:45.777605 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.779046 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] For port b62383e4-d9b3-418e-88f9-01eec51d2fe7, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b62383e4-d9b3-418e-88f9-01eec51d2fe7,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:45.793599 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.857891 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aad9ff6-7991-463f-8dc8-d1b8e024cd95 None None] Pushing event updated for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:45.871609 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:45.872410 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:45.911142 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 22e5dde0-ff30-45e4-8c36-5713ab3df45d up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:45.922024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:45.991708 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:46.046842 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 22e5dde0-ff30-45e4-8c36-5713ab3df45d triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:46.047102 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.095347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-a111c2b8-7beb-477d-8009-545d76e790c7 None None] Provisioning complete for port 22e5dde0-ff30-45e4-8c36-5713ab3df45d triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:46.095756 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a111c2b8-7beb-477d-8009-545d76e790c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.125467 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Allocated IP 172.20.0.1 (3e6e03e1-f7bd-45ef-801e-102163545fa4/13d7214d-dca8-4983-8a11-153b45bde2ef/dff0772e-eded-49f0-932d-f7b33ff8a3d6) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:46.215286 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:45Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:46.232707 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.242335 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb5fa8b9-8956-47e8-b3af-1cd7448111ff None None] The sync data for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi is: [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:45Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:46.269650 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.319178 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:46.322119 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:46.323679 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.326215 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:46.351661 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Pushing event updated for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:46.374252 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks [] for port, precommit_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.380294 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3753420'] for router_interface, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.389710 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.433935 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 22e5dde0-ff30-45e4-8c36-5713ab3df45d, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=22e5dde0-ff30-45e4-8c36-5713ab3df45d,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:46.454873 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a111c2b8-7beb-477d-8009-545d76e790c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.467923 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.468666 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:46.517294 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Attempting to bind port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:46.517762 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Attempting to bind port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:46.518014 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Attempting to bind port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d on network 5536583f-f2fb-4579-9b55-62f8818c8ea0 {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:46.518902 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.533928 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c54e4a-205a-4d2d-98c3-7b2f30885c77 None None] Pushing event updated for resources: {'Port': ['ID=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,revision_number=2']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:46.548450 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:46.548857 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Checking segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:46.549211 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.549600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Bound using segment: {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'} {{(pid=108143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:46.550085 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.managers [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Bound port: 32f3317a-35cc-4d86-b95b-9deb35b0ca6d, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c49a3786-2afe-45a0-abea-ecf0c6157177', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0'}}] {{(pid=108143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:46.550459 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.657180 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=22e5dde0-ff30-45e4-8c36-5713ab3df45d,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:46.845156 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:46.845663 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:46.851922 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.db.api [None req-a111c2b8-7beb-477d-8009-545d76e790c7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108143) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 15 17:56:46.852251 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG oslo_db.api [None req-a111c2b8-7beb-477d-8009-545d76e790c7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 15 17:56:46.882931 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] For port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:46.901220 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] For port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:46.912638 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.008686 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.014993 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.018520 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c54e4a-205a-4d2d-98c3-7b2f30885c77 None None] Pushing event updated for resources: {'Port': ['ID=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,revision_number=3']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:47.032906 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:47.033466 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:47.080690 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3731252', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3753296'] for router_interface, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.083363 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Pushing event updated for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:47.135872 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:47.178656 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:47.180265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:47.293400 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Router 5c9ae027-a7b7-41f2-ab49-9c358b6610db has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:56:47.346673 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dff0772e-eded-49f0-932d-f7b33ff8a3d6', 'name': '', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'mac_address': 'fa:16:3e:66:da:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:45Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 2, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'subnets': [{'id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:47.375886 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d188f9bd-2fe3-4a55-a1e3-1b8516ab0e5d None None] The sync data for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi is: [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dff0772e-eded-49f0-932d-f7b33ff8a3d6', 'name': '', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'mac_address': 'fa:16:3e:66:da:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:45Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 2, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'subnets': [{'id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:47.405343 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:56:47.412166 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0ee8f18e-40d9-434e-b680-c874f9db2099 admin admin] 10.222.0.31 "PUT /v2.0/routers/5c9ae027-a7b7-41f2-ab49-9c358b6610db/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1062634 Nov 15 17:56:47.532998 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Provisioning complete for port 22e5dde0-ff30-45e4-8c36-5713ab3df45d triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:47.533276 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.646604 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Provisioning complete for port dff0772e-eded-49f0-932d-f7b33ff8a3d6 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:47.646968 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.696924 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Port dff0772e-eded-49f0-932d-f7b33ff8a3d6 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:56:47.712212 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Provisioning complete for port b62383e4-d9b3-418e-88f9-01eec51d2fe7 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:47.712789 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.751956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 22e5dde0-ff30-45e4-8c36-5713ab3df45d up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:47.851912 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 22e5dde0-ff30-45e4-8c36-5713ab3df45d triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:47.852577 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.884409 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:47.936142 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] For port b62383e4-d9b3-418e-88f9-01eec51d2fe7, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b62383e4-d9b3-418e-88f9-01eec51d2fe7,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:47.942552 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:48.015750 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b62383e4-d9b3-418e-88f9-01eec51d2fe7 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:48.049047 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55dd383-3fe2-4e48-9267-6fc74c4cf80e None None] Pushing event updated for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:48.074655 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b62383e4-d9b3-418e-88f9-01eec51d2fe7 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:48.075248 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:49.694937 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 32f3317a-35cc-4d86-b95b-9deb35b0ca6d up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:49.758052 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:49.758326 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:49.863474 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:49.892995 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] For port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:49.898037 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:49.898836 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b62383e4-d9b3-418e-88f9-01eec51d2fe7 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:49.988332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Pushing event updated for resources: {'Port': ['ID=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:49.996007 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port b62383e4-d9b3-418e-88f9-01eec51d2fe7 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:49.996435 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:50.374282 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Sync routers for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:56:50.385645 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:50.386250 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:50.499780 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:50.856758 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dff0772e-eded-49f0-932d-f7b33ff8a3d6', 'name': '', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'mac_address': 'fa:16:3e:66:da:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:45Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 2, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'subnets': [{'id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:50.887092 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Checking router: 5c9ae027-a7b7-41f2-ab49-9c358b6610db for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:56:50.887404 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Updating router 5c9ae027-a7b7-41f2-ab49-9c358b6610db port dff0772e-eded-49f0-932d-f7b33ff8a3d6 binding host dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 17:56:50.924461 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.230277 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks [] for port, precommit_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.236972 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.298389 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Pushing event updated for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=3']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:51.330875 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.331738 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.332126 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.332447 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.333242 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.333594 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.333916 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.334230 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.335025 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.335025 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.336384 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.336384 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:51.474106 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Attempting to bind port dff0772e-eded-49f0-932d-f7b33ff8a3d6 on host dv-cinder-788366-7-iscsi for vnic_type normal with profile {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:56:51.474733 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Attempting to bind port dff0772e-eded-49f0-932d-f7b33ff8a3d6 by drivers openvswitch,hyperv on host dv-cinder-788366-7-iscsi at level 0 using segments [{'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:56:51.474867 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Attempting to bind port dff0772e-eded-49f0-932d-f7b33ff8a3d6 on network 3e6e03e1-f7bd-45ef-801e-102163545fa4 {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:56:51.482006 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Checking agent: {'id': '12caaafc-7eff-4180-add1-7570922411ee', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-788366-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 40, 7), 'started_at': datetime.datetime(2021, 11, 15, 17, 40, 37), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-788366-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:56:51.482396 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Checking segment: {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:56:51.482866 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.483321 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Bound using segment: {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'} {{(pid=108144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:56:51.483836 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.managers [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Bound port: dff0772e-eded-49f0-932d-f7b33ff8a3d6, host: dv-cinder-788366-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0ca50e6-67a1-4c41-a0b4-6a2751838480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4'}}] {{(pid=108144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:56:51.484954 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.572757 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] For port dff0772e-eded-49f0-932d-f7b33ff8a3d6, host dv-cinder-788366-7-iscsi, cleared binding levels {{(pid=108144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:56:51.576826 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.plugins.ml2.db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] For port dff0772e-eded-49f0-932d-f7b33ff8a3d6, host dv-cinder-788366-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dff0772e-eded-49f0-932d-f7b33ff8a3d6,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:56:51.584524 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron_lib.callbacks.manager [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.603740 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] Provisioning complete for port dff0772e-eded-49f0-932d-f7b33ff8a3d6 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:51.603740 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.648447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 32f3317a-35cc-4d86-b95b-9deb35b0ca6d up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:51.668246 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b351590-5724-4ced-a6e8-1543964e0609 None None] Pushing event updated for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=4']} {{(pid=108144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:51.686471 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:56:51.687505 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:56:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:51.772142 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.811143 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] For port dff0772e-eded-49f0-932d-f7b33ff8a3d6, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dff0772e-eded-49f0-932d-f7b33ff8a3d6,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:56:51.832511 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.837194 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:51.837565 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:51.845576 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:56:51.961173 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13238f2-ac25-429a-b0a7-b537ef67cb13 None None] Pushing event updated for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:52.057456 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-af2ab402-82b0-4bb8-9054-874a056dcf1e None None] Provisioning complete for port dff0772e-eded-49f0-932d-f7b33ff8a3d6 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:52.058225 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-af2ab402-82b0-4bb8-9054-874a056dcf1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:52.129715 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dff0772e-eded-49f0-932d-f7b33ff8a3d6', 'name': '', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'mac_address': 'fa:16:3e:66:da:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:45Z', 'updated_at': '2021-11-15T17:56:51Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'subnets': [{'id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:56:52.167684 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e0ba98b-a7e0-4191-b3a9-a5b59dcd4fc0 None None] The sync data for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi is: [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:56:46Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'dff0772e-eded-49f0-932d-f7b33ff8a3d6', 'name': '', 'network_id': '3e6e03e1-f7bd-45ef-801e-102163545fa4', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'mac_address': 'fa:16:3e:66:da:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:45Z', 'updated_at': '2021-11-15T17:56:51Z', 'revision_number': 4, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'subnets': [{'id': '13d7214d-dca8-4983-8a11-153b45bde2ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:56:52.395235 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:53.673830 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dff0772e-eded-49f0-932d-f7b33ff8a3d6 up at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:56:53.724378 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Provisioning complete for port dff0772e-eded-49f0-932d-f7b33ff8a3d6 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:53.724733 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:57.339795 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc83da8f-347c-40b6-8030-9dfced6942b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:57.341304 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc83da8f-347c-40b6-8030-9dfced6942b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 814 time: 0.1068678 Nov 15 17:56:57.356701 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-db12ead3-b4d1-409a-ab3d-297979b0385d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/quotas/6178223d48944b6ba503c95dcdaa1089 HTTP/1.1" status: 200 len: 375 time: 0.0093377 Nov 15 17:56:57.409583 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-18bbd656-7755-450a-ada3-802dc01db5cf tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0477176 Nov 15 17:56:57.513826 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-e8a41dc8-09f9-4520-bc8d-03d3b40b0d2c service neutron] 10.222.0.31 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923266 Nov 15 17:56:57.607756 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-8d5e2561-0a87-4137-9575-0690e91ed176 service neutron] 10.222.0.31 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872610 Nov 15 17:56:57.771122 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86889f98-9370-4bd3-b7bb-1731d92eb310 req-e6e25402-16f9-4523-8194-67d62522a458 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 210 time: 0.0303192 Nov 15 17:56:58.780692 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-306606a8-d5a8-46bf-9fcc-e3730e32b19c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:58.782155 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-306606a8-d5a8-46bf-9fcc-e3730e32b19c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 814 time: 0.1064396 Nov 15 17:56:58.796657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'port': {'device_id': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'admin_state_up': True, 'tenant_id': '6178223d48944b6ba503c95dcdaa1089'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:56:58.868207 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-88d1ea03-b91e-4ed2-a1ac-1d12edc245e6 req-0cc3ed9b-f48c-408c-8e61-5855d07d378a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 210 time: 0.0286167 Nov 15 17:56:58.909457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Made reservation on behalf of 6178223d48944b6ba503c95dcdaa1089 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:56:58.913112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:59.040439 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Allocated IP 172.20.0.4 (c79add16-3f72-42fd-a9c3-e0a2bf5f312f/775e7c93-5715-4404-bdb1-411ccedb6a65/ef009656-31c1-4948-9072-989fa7241e3b) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:56:59.195295 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:59.231443 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:59.303588 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:56:59.314253 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:56:59.316096 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.316433 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.316760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.317085 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.317404 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.317722 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.318078 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.318395 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.318741 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.319052 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.319366 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.319683 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:56:59.324143 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:56:59.328816 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:56:59.379907 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:59.380546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:59.400238 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-fb50ba9b-c7ef-468f-b945-df78e385f204 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6085951 Nov 15 17:56:59.629670 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-8b218bfd-99a3-4117-a203-1c4f3ddd25e2 None None] Provisioning complete for port ef009656-31c1-4948-9072-989fa7241e3b triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:56:59.630317 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-8b218bfd-99a3-4117-a203-1c4f3ddd25e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:56:59.666836 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-8b218bfd-99a3-4117-a203-1c4f3ddd25e2 None None] Port ef009656-31c1-4948-9072-989fa7241e3b cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:56:59.988124 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80bfafaf-cda8-465f-a2f9-9815f64502c5 req-b3c39f65-88b2-40da-9c83-3a7463188084 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:56:59.990071 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-80bfafaf-cda8-465f-a2f9-9815f64502c5 req-b3c39f65-88b2-40da-9c83-3a7463188084 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0509901 Nov 15 17:57:00.038520 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-80bfafaf-cda8-465f-a2f9-9815f64502c5 req-9c6dd1fc-f31b-4fb1-a19a-ba81cd6d86f0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422812 Nov 15 17:57:00.800497 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-24e04b23-0baa-4a8d-a1e2-f87097689560 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:01.197484 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea8fbe-7bfb-4680-9461-06d8bbf58191 req-245e1d7d-9c71-4e4d-aad0-4011076d8760 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:01.199076 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-23ea8fbe-7bfb-4680-9461-06d8bbf58191 req-245e1d7d-9c71-4e4d-aad0-4011076d8760 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0806262 Nov 15 17:57:01.251601 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-23ea8fbe-7bfb-4680-9461-06d8bbf58191 req-475e2be9-0440-45ac-b245-1c344d338f22 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462210 Nov 15 17:57:02.369327 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af665789-ac28-49f5-b408-f40c9d19253b req-fed907a9-569d-4776-aba1-76de1002bc9e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:02.370871 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af665789-ac28-49f5-b408-f40c9d19253b req-fed907a9-569d-4776-aba1-76de1002bc9e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0501833 Nov 15 17:57:02.420466 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af665789-ac28-49f5-b408-f40c9d19253b req-3bba1a78-9af3-419f-88fc-4b2adc120c1f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428381 Nov 15 17:57:03.104614 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-0f61af98-d745-4f5e-85c2-45124293c26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:03.560655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e28614-c614-48c4-a3e0-a6f0594f3111 req-5fac038b-4177-44cc-9494-c276ae263efb tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:03.562247 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c1e28614-c614-48c4-a3e0-a6f0594f3111 req-5fac038b-4177-44cc-9494-c276ae263efb tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0707917 Nov 15 17:57:03.620884 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c1e28614-c614-48c4-a3e0-a6f0594f3111 req-27fa0ae1-65ce-4e0c-a018-bd8ee973c8dc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522761 Nov 15 17:57:04.495175 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:04.768903 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b86aba2-ca4b-4eb0-8eaf-2d17e6b2b32e req-31c24407-35f2-4f18-ad14-ae1c26fc3ec3 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:04.770345 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b86aba2-ca4b-4eb0-8eaf-2d17e6b2b32e req-31c24407-35f2-4f18-ad14-ae1c26fc3ec3 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0615919 Nov 15 17:57:04.819470 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-1b86aba2-ca4b-4eb0-8eaf-2d17e6b2b32e req-3a6a0b66-debd-4363-a366-30e3303f15ec tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427258 Nov 15 17:57:05.604813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:05.944159 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49a3a02-481f-40c6-9bad-eb0612e755c7 req-be1fcc11-e319-4d22-9e5a-327b99c46805 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:05.945908 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c49a3a02-481f-40c6-9bad-eb0612e755c7 req-be1fcc11-e319-4d22-9e5a-327b99c46805 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0566232 Nov 15 17:57:05.998017 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c49a3a02-481f-40c6-9bad-eb0612e755c7 req-e39b96b1-5a6c-43e0-8d14-a8192ec2f197 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459151 Nov 15 17:57:06.670154 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:07.129931 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52854348-5ae3-4dc8-8486-bd5fb44c928a req-ac8ce7c6-1685-4be2-b30a-51823d16144c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:07.131488 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-52854348-5ae3-4dc8-8486-bd5fb44c928a req-ac8ce7c6-1685-4be2-b30a-51823d16144c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0559411 Nov 15 17:57:07.178000 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-52854348-5ae3-4dc8-8486-bd5fb44c928a req-e6baa9b7-94b4-4f9b-95e6-10d86e330fec tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405269 Nov 15 17:57:08.314294 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bdcd3be-a9e3-4b66-8ef1-abe75f25ebb8 req-adce6dd2-07c4-4a67-8209-e2e334a4a685 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:08.315833 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7bdcd3be-a9e3-4b66-8ef1-abe75f25ebb8 req-adce6dd2-07c4-4a67-8209-e2e334a4a685 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0510859 Nov 15 17:57:08.366066 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7bdcd3be-a9e3-4b66-8ef1-abe75f25ebb8 req-7520629d-c705-4236-8b4c-2bad6e058042 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440485 Nov 15 17:57:09.491075 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f16dbdb-bbf3-46d6-9f39-dc7e75f797b8 req-2b153c64-65d7-4bfc-974b-980804b28b01 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:09.492635 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f16dbdb-bbf3-46d6-9f39-dc7e75f797b8 req-2b153c64-65d7-4bfc-974b-980804b28b01 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0507023 Nov 15 17:57:09.544353 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3f16dbdb-bbf3-46d6-9f39-dc7e75f797b8 req-08cd045f-3971-4b25-84cf-ef9e2f0d586c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455706 Nov 15 17:57:10.667982 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb8b728-4203-448c-92c0-2c021dcf10bf req-1e0b2217-aba2-4256-bb7d-6a9df9c999ef tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:10.669467 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2cb8b728-4203-448c-92c0-2c021dcf10bf req-1e0b2217-aba2-4256-bb7d-6a9df9c999ef tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0534241 Nov 15 17:57:10.717329 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2cb8b728-4203-448c-92c0-2c021dcf10bf req-0fdd5381-ef24-4971-8967-796259df4ec3 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415454 Nov 15 17:57:11.489709 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Request body: {'port': {'device_id': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:11.548423 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:11.807923 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ef009656-31c1-4948-9072-989fa7241e3b {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:57:11.815194 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:11.826840 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Transition to ACTIVE for port object ef009656-31c1-4948-9072-989fa7241e3b will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:57:11.832122 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:11.839552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ef2a04-ab4f-40bb-9631-728bbce76f02 req-4b08e112-7ea1-449f-8cb4-c6d4e0fb122f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:11.841064 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d6ef2a04-ab4f-40bb-9631-728bbce76f02 req-4b08e112-7ea1-449f-8cb4-c6d4e0fb122f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 931 time: 0.0491834 Nov 15 17:57:11.884350 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:11.889969 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d6ef2a04-ab4f-40bb-9631-728bbce76f02 req-0ad68985-0d6c-4661-9d10-fa9ef7b63a05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428364 Nov 15 17:57:11.957487 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Attempting to bind port ef009656-31c1-4948-9072-989fa7241e3b on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:57:11.957831 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Attempting to bind port ef009656-31c1-4948-9072-989fa7241e3b by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:57:11.958166 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Attempting to bind port ef009656-31c1-4948-9072-989fa7241e3b on network c79add16-3f72-42fd-a9c3-e0a2bf5f312f {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:57:11.962962 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Port ef009656-31c1-4948-9072-989fa7241e3b on network c79add16-3f72-42fd-a9c3-e0a2bf5f312f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:57:11.963283 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Attempting to bind port ef009656-31c1-4948-9072-989fa7241e3b on network c79add16-3f72-42fd-a9c3-e0a2bf5f312f {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:57:11.968295 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 56, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:57:11.968635 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Checking segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:57:11.969019 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Bound using segment: {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:57:11.969449 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Bound port: ef009656-31c1-4948-9072-989fa7241e3b, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '42b749ed-dfd6-4403-8018-6ac2558cada8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:57:11.969806 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:12.034121 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:57:12.037578 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:57:12.043215 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:12.080810 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.081367 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:12.083475 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] 10.222.0.48 "PUT /v2.0/ports/ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 1093 time: 0.5984087 Nov 15 17:57:12.085847 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:12.088836 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-840f7e72-980f-435c-a5f5-e1cbcdbed03c" -d '{"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:12.126090 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6a3246-a993-46d5-8e1c-0ac1e213103b service neutron] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:12.156715 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f65f3674-e7bb-4654-929d-0a02605e4cab x-openstack-request-id: req-f65f3674-e7bb-4654-929d-0a02605e4cab {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:12.157042 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:12.157232 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f65f3674-e7bb-4654-929d-0a02605e4cab {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:12.157613 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:57:12.173828 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-603747a9-512f-4599-985b-48adddd4571b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.175621 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-603747a9-512f-4599-985b-48adddd4571b service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1096 time: 0.0461767 Nov 15 17:57:12.216872 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-b40c80ff-7c6f-40b5-b511-d4f5e3068f1b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 217 time: 0.0337570 Nov 15 17:57:12.268019 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-ba166731-2df3-4e30-b5eb-285642529101 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.269561 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-ba166731-2df3-4e30-b5eb-285642529101 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0450714 Nov 15 17:57:12.319119 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-a74a36de-e686-4cfa-a496-afed0cfba020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.320643 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-a74a36de-e686-4cfa-a496-afed0cfba020 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437191 Nov 15 17:57:12.413155 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-14ae29b0-994c-4ea1-a686-878cc47abeeb service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847759 Nov 15 17:57:12.512123 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-a075d5df-17a2-4b85-8c14-e305d53af2a2 req-40f01eeb-3288-4ab0-b3bd-0f1f0f896baa service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907578 Nov 15 17:57:12.606954 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-792124b3-5d54-448a-8efb-b459dde9bff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.608416 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-792124b3-5d54-448a-8efb-b459dde9bff7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1096 time: 0.0427887 Nov 15 17:57:12.962714 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-cef31ee6-bd68-4925-82e9-8e99553b1fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:12.964335 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-cef31ee6-bd68-4925-82e9-8e99553b1fe0 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.3485367 Nov 15 17:57:13.006584 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-6ebcd994-1816-4407-a675-833545619a31 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 217 time: 0.0343544 Nov 15 17:57:13.019004 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30884afe-c017-42ab-bd4f-2d7d31e66aba req-f87981cf-022e-43bd-8c07-4af6d105f0a1 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:13.020598 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-30884afe-c017-42ab-bd4f-2d7d31e66aba req-f87981cf-022e-43bd-8c07-4af6d105f0a1 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 943 time: 0.0522225 Nov 15 17:57:13.056829 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-69e59bf8-0fec-4004-b5f2-45f0e014cb0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:13.058306 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-69e59bf8-0fec-4004-b5f2-45f0e014cb0a service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0437231 Nov 15 17:57:13.067137 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-30884afe-c017-42ab-bd4f-2d7d31e66aba req-030952f1-aaf4-4a47-b016-b237cb677e29 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404072 Nov 15 17:57:13.108714 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-8d5bfc37-34f0-463b-a790-c0c4f9c1ee88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:13.110232 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-8d5bfc37-34f0-463b-a790-c0c4f9c1ee88 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430343 Nov 15 17:57:13.217053 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-0739fa6f-8230-47bf-a74d-0f92dccf99c2 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978541 Nov 15 17:57:13.312925 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-840f7e72-980f-435c-a5f5-e1cbcdbed03c req-c4866785-f7fc-4c13-bcd1-1dde29ada4f0 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869389 Nov 15 17:57:14.195762 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6701cbd3-32a2-4fa4-852a-29c462bcd864 req-63a7d3e0-bf52-4a37-9ec5-97804ff68079 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:14.197262 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6701cbd3-32a2-4fa4-852a-29c462bcd864 req-63a7d3e0-bf52-4a37-9ec5-97804ff68079 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 943 time: 0.0542901 Nov 15 17:57:14.246584 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6701cbd3-32a2-4fa4-852a-29c462bcd864 req-389590c9-a491-4251-8780-bae4956cde72 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432861 Nov 15 17:57:15.377775 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4084bb-93c7-4f0c-9e77-85c1a2b7dad5 req-dcd3b218-e0f4-4832-be08-3935f59b439a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:15.379471 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4f4084bb-93c7-4f0c-9e77-85c1a2b7dad5 req-dcd3b218-e0f4-4832-be08-3935f59b439a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 943 time: 0.0516236 Nov 15 17:57:15.431194 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4f4084bb-93c7-4f0c-9e77-85c1a2b7dad5 req-f44ca992-e0c0-454b-8ffa-27f4ca3dd025 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457118 Nov 15 17:57:15.788083 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device ef009656-31c1-4948-9072-989fa7241e3b details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:57:15.896378 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:15.907157 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'ef009656-31c1-4948-9072-989fa7241e3b', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'port_id': 'ef009656-31c1-4948-9072-989fa7241e3b', 'mac_address': 'fa:16:3e:a7:e6:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 411, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:57:15.949307 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:15.962150 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ef009656-31c1-4948-9072-989fa7241e3b {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:57:15.981219 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:15.988852 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:16.035415 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:16.221509 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:57:16.564775 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840e01eb-7354-4477-b18e-5dacc364e505 req-79cd6aa9-ace4-4f0d-9a2c-28972006427c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:16.566267 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-840e01eb-7354-4477-b18e-5dacc364e505 req-79cd6aa9-ace4-4f0d-9a2c-28972006427c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 944 time: 0.0610790 Nov 15 17:57:16.618224 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-840e01eb-7354-4477-b18e-5dacc364e505 req-a4e64839-a0ea-4c0d-83e5-55f95dfcb0e5 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430849 Nov 15 17:57:17.753374 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e994744c-f4b8-41ef-a95a-872a6f458853 req-5b946c1f-5736-4a93-b50d-307a5142941a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:17.754838 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e994744c-f4b8-41ef-a95a-872a6f458853 req-5b946c1f-5736-4a93-b50d-307a5142941a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 944 time: 0.0510652 Nov 15 17:57:17.801668 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e994744c-f4b8-41ef-a95a-872a6f458853 req-703fc311-5eeb-4f4e-adab-852aea5b5d5f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407763 Nov 15 17:57:17.801925 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device ef009656-31c1-4948-9072-989fa7241e3b up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:57:17.852896 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port ef009656-31c1-4948-9072-989fa7241e3b completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:57:17.857092 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port ef009656-31c1-4948-9072-989fa7241e3b triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:57:17.857464 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:17.933187 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:17.959751 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:17.962021 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f90cf5de-32b8-4221-a0c4-0b043a57354f" -d '{"events": [{"server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "name": "network-vif-plugged", "status": "completed", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:17.975447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:17.980575 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:18.003764 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c3fe4c8-22ca-4028-bef5-3a8a107a23cc x-openstack-request-id: req-4c3fe4c8-22ca-4028-bef5-3a8a107a23cc {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:18.004172 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "name": "network-vif-plugged", "status": "completed", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:18.004506 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4c3fe4c8-22ca-4028-bef5-3a8a107a23cc {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:18.005110 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'code': 200} Nov 15 17:57:18.030795 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:18.037992 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.038336 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.038708 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.039032 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.039361 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.039635 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.040027 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.040348 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.040667 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.041081 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.041279 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.041611 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:18.170626 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb35594-3934-4eea-9ffd-9e4327f1d15d req-813e01a0-c64a-4d30-9c88-2d9a61f9a9f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:18.171978 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6eb35594-3934-4eea-9ffd-9e4327f1d15d req-813e01a0-c64a-4d30-9c88-2d9a61f9a9f3 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1098 time: 0.0387940 Nov 15 17:57:18.218258 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6eb35594-3934-4eea-9ffd-9e4327f1d15d req-ee4b2e05-b87b-440a-b148-3cb07e85baaf service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391104 Nov 15 17:57:18.938586 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6634a0a-711d-4e47-82a4-472d91887434 req-434b1624-35c0-4a1f-9431-c43288fee44e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:18.939978 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e6634a0a-711d-4e47-82a4-472d91887434 req-434b1624-35c0-4a1f-9431-c43288fee44e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0609095 Nov 15 17:57:18.997170 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e6634a0a-711d-4e47-82a4-472d91887434 req-c286d52f-4071-439f-9bb0-b18571d0ca0b tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505185 Nov 15 17:57:20.131062 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9df054d-a037-4a4f-a256-4c45793e8e31 req-bba6a501-e4d9-42e6-ba96-651a0f732682 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:20.132576 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a9df054d-a037-4a4f-a256-4c45793e8e31 req-bba6a501-e4d9-42e6-ba96-651a0f732682 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0531096 Nov 15 17:57:20.183007 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a9df054d-a037-4a4f-a256-4c45793e8e31 req-3263c481-e3aa-4e4d-9e36-276bba8fe84c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418503 Nov 15 17:57:20.304876 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-345a00e4-1d3c-4b1d-abf3-669c98d9bfc9 req-6ee5d06e-edf6-44b5-95d9-86ca325c3b51 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:20.306243 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-345a00e4-1d3c-4b1d-abf3-669c98d9bfc9 req-6ee5d06e-edf6-44b5-95d9-86ca325c3b51 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0557222 Nov 15 17:57:20.358387 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-345a00e4-1d3c-4b1d-abf3-669c98d9bfc9 req-7ecdaa69-3bc2-4984-a376-bf55661494b7 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431740 Nov 15 17:57:20.717759 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa35344-c235-4888-8ef1-c6e450e99f17 req-c69fa24c-f507-46ec-8752-c19c9f610d0d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:20.719244 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4fa35344-c235-4888-8ef1-c6e450e99f17 req-c69fa24c-f507-46ec-8752-c19c9f610d0d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0555227 Nov 15 17:57:20.782262 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4fa35344-c235-4888-8ef1-c6e450e99f17 req-86a12e08-c7df-4db5-b177-bef15a96fb33 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539272 Nov 15 17:57:22.059054 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:57:22.411422 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:27.106152 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-8db883f6-6784-4544-8029-fd4a7263626a service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0470982 Nov 15 17:57:27.190959 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-df5e7fa7-5b4d-41a4-85d0-35914a8bc25c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:27.192501 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-df5e7fa7-5b4d-41a4-85d0-35914a8bc25c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1099 time: 0.0410788 Nov 15 17:57:27.304896 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-27d924b0-d7f7-4297-8270-fec7019af28f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:27.306347 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-27d924b0-d7f7-4297-8270-fec7019af28f service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0890427 Nov 15 17:57:27.381056 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-1f12b5f8-3840-47b8-a5d4-8e87a2638ac6 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 1002 time: 0.0647070 Nov 15 17:57:27.433336 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-c412b380-8ce0-49cb-94bd-4054577e023c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:27.434806 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-c412b380-8ce0-49cb-94bd-4054577e023c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0459507 Nov 15 17:57:27.483409 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-6f82f87c-3a75-4775-afc6-13cad1b1b8e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:27.484987 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-6f82f87c-3a75-4775-afc6-13cad1b1b8e0 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412679 Nov 15 17:57:27.592515 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-aaf9ec79-908f-4aa1-ba8a-0a9ac2d723d9 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0988600 Nov 15 17:57:27.688731 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b31e7995-e7c6-465b-8627-9c4dd0280d69 req-8253d73e-70e5-4930-8d17-f13b2f2e9699 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882020 Nov 15 17:57:28.488694 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-a5850fe8-a563-4294-ac3e-aea3fb56503e tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1950932927&fields=id&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 267 time: 0.0590160 Nov 15 17:57:28.599511 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-4955e752-42e4-4c1e-abd4-c917eb3a5803 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:28.600979 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-4955e752-42e4-4c1e-abd4-c917eb3a5803 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1047132 Nov 15 17:57:28.619618 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-c6bab815-47da-4526-ad02-774c8f1e67f9 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/quotas/02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 375 time: 0.0102515 Nov 15 17:57:28.681006 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-43e61e8c-c3d5-4cb6-a6ed-1454bea43265 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0535791 Nov 15 17:57:28.794570 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-cec18877-28a4-47df-884f-30d12e52fe80 service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0957122 Nov 15 17:57:28.897024 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-cf5ae90b-aef5-4a7b-a8ee-fa6200ad6bda service neutron] 10.222.0.31 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931795 Nov 15 17:57:29.184655 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3abf1719-7ba9-4ad6-9759-32e8a20ab648 req-90021f27-157e-4fcd-923f-fe4820e94fee tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 210 time: 0.0293026 Nov 15 17:57:30.133063 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-6e71962c-4c40-4f68-9b75-a27c0e9d261c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:30.134610 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-6e71962c-4c40-4f68-9b75-a27c0e9d261c tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 812 time: 0.1113806 Nov 15 17:57:30.202451 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-68fb7c90-f1fb-47da-a390-ed1def25b233 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8 HTTP/1.1" status: 200 len: 380 time: 0.0568335 Nov 15 17:57:30.212456 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'port': {'device_id': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'admin_state_up': True, 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'security_groups': ['d1957e86-4d23-410d-832b-14bd8f646ece']}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:30.278755 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d59469d6-36e0-4f4a-b848-bc4b125be970 req-6152d28c-f240-4491-af71-8d694ee80f92 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 210 time: 0.0261734 Nov 15 17:57:30.324120 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Made reservation on behalf of 02ec9c6dcc7d48c5b52b4ee146d42ec8 for: {'port': 1} {{(pid=108142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 17:57:30.328098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.472420 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.20.0.5 (225bbc0e-9530-4b54-be05-d3092f2f1bf3/4800e8bb-9314-46c0-b919-995a65894f5c/d86b2d7c-54b7-4f20-ae69-6c89d42fea89) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:57:30.617528 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.651526 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.715038 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:57:30.716698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:30.719369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:57:30.721623 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:57:30.774049 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:30.775072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.797220 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-3c0fcdf3-fd5f-4fd2-85ce-ed04bdc15ec0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5885880 Nov 15 17:57:30.814541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Request body: {'port': {'device_id': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78836'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:30.876218 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.881198 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-00c450bb-85dd-426c-9326-300e33de2686 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.958360 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-5c2c88c3-9072-404b-9bca-5ca7ac5e49fe None None] Provisioning complete for port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:57:30.958825 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-5c2c88c3-9072-404b-9bca-5ca7ac5e49fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:30.992219 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-5c2c88c3-9072-404b-9bca-5ca7ac5e49fe None None] Port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 cannot update to ACTIVE because it is not bound. {{(pid=108143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 17:57:31.145675 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d86b2d7c-54b7-4f20-ae69-6c89d42fea89 {{(pid=108142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:57:31.154223 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:31.169008 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.provisioning_blocks [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Transition to ACTIVE for port object d86b2d7c-54b7-4f20-ae69-6c89d42fea89 will not be triggered until provisioned by entity L2. {{(pid=108142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 17:57:31.173545 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:31.225595 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Pushing event updated for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:31.294906 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Attempting to bind port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 on host hv-cinder-78836 for vnic_type normal with profile {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 17:57:31.295208 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Attempting to bind port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 by drivers openvswitch,hyperv on host hv-cinder-78836 at level 0 using segments [{'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 17:57:31.295521 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Attempting to bind port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:57:31.300291 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78836 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 17:57:31.300609 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Attempting to bind port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 on network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 17:57:31.306371 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Checking agent: {'id': '270583ae-f494-4e2b-99fb-f0bb7937d2e9', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78836', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'started_at': datetime.datetime(2021, 11, 15, 17, 46, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 17, 57, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 17:57:31.307414 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Checking segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 17:57:31.307414 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Bound using segment: {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'} {{(pid=108142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 17:57:31.307752 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.managers [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Bound port: d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host: hv-cinder-78836, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47d0b0f5-1317-4399-8742-1fd52fe341fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3'}}] {{(pid=108142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 17:57:31.308088 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:31.373455 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, cleared binding levels {{(pid=108142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 17:57:31.376482 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 17:57:31.382077 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:31.404197 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5627be0-7cae-477e-abf6-c1565299bfa2 req-3699f528-de32-46c7-bdbd-01700af50dfe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:31.406003 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5627be0-7cae-477e-abf6-c1565299bfa2 req-3699f528-de32-46c7-bdbd-01700af50dfe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0531151 Nov 15 17:57:31.424031 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:31.424692 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:31.426077 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] 10.222.0.48 "PUT /v2.0/ports/d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 200 len: 1093 time: 0.6163437 Nov 15 17:57:31.426559 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:31.429220 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a501017-20fb-41f5-b599-1be9c8d3b7c7" -d '{"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:31.457886 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7056fb2d-af96-4f6c-940a-0a8017c17ed5 service neutron] Pushing event updated for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=3']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:31.494054 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5627be0-7cae-477e-abf6-c1565299bfa2 req-b6f02717-256e-4edf-997b-775744597ff6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0798905 Nov 15 17:57:31.515562 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6382c5f-a5a4-4310-bbed-d0738cd04de4 x-openstack-request-id: req-f6382c5f-a5a4-4310-bbed-d0738cd04de4 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:31.516008 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:31.516228 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f6382c5f-a5a4-4310-bbed-d0738cd04de4 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:31.516730 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'status': 'completed', 'code': 200} Nov 15 17:57:31.535391 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-ddd07d3f-f5ef-4212-aae9-11bc92620bab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:31.537336 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-ddd07d3f-f5ef-4212-aae9-11bc92620bab service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1096 time: 0.0688655 Nov 15 17:57:31.588610 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-93481475-466c-40b0-bbc6-4cd76e3407ec service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 200 len: 217 time: 0.0408664 Nov 15 17:57:31.649384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-2cfdc45c-d7e2-465e-b295-59cdf08ab074 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:31.650864 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-2cfdc45c-d7e2-465e-b295-59cdf08ab074 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0489202 Nov 15 17:57:31.701304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-b2666c97-a90b-4312-aaa3-79f974282981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:31.702829 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-b2666c97-a90b-4312-aaa3-79f974282981 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413764 Nov 15 17:57:31.797583 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-f11db99f-bd5d-49ef-afc3-129cbb59dfb9 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856669 Nov 15 17:57:31.899412 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7f041fdc-5f49-484f-8ed7-8d30601ac9e3 req-05c15782-99fd-4cce-b3af-525356307377 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939724 Nov 15 17:57:31.999563 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-179ced03-557d-4910-b7aa-b294d3f2eb78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.001071 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-179ced03-557d-4910-b7aa-b294d3f2eb78 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1096 time: 0.0465899 Nov 15 17:57:32.111731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-9dd7b452-bc2f-431f-9574-532d37cd7421 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.113290 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-9dd7b452-bc2f-431f-9574-532d37cd7421 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.1033854 Nov 15 17:57:32.161853 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-6d6c01fd-157e-4535-8cb4-3fbfe44c13aa service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 200 len: 217 time: 0.0372508 Nov 15 17:57:32.211932 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-f1296b03-16db-406e-a618-e4cb930628d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.213502 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-f1296b03-16db-406e-a618-e4cb930628d8 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0445271 Nov 15 17:57:32.263369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-b0104f51-8575-4a9a-84f1-67182a1068b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.264931 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-b0104f51-8575-4a9a-84f1-67182a1068b7 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408034 Nov 15 17:57:32.355864 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-552abfdb-02e0-4b4b-b4de-96fa8389c824 req-5c58009a-90ec-465a-a39c-6d6ba7c0090e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.357376 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-552abfdb-02e0-4b4b-b4de-96fa8389c824 req-5c58009a-90ec-465a-a39c-6d6ba7c0090e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0477037 Nov 15 17:57:32.360203 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-93af2416-bc73-4b54-8352-6c2524563a93 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864258 Nov 15 17:57:32.408295 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-552abfdb-02e0-4b4b-b4de-96fa8389c824 req-3ccb3d56-723c-4e75-9237-e49c671ba23f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449791 Nov 15 17:57:32.431507 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34086) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:32.457184 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-9a501017-20fb-41f5-b599-1be9c8d3b7c7 req-40cb4d06-97f6-4990-bf80-b793d5fb6b52 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858924 Nov 15 17:57:32.562924 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b2eae06-fd3e-4aff-80d2-7df8eb93cd5e tempest-TestMinimumBasicScenario-1717942308 tempest-TestMinimumBasicScenario-1717942308-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.564432 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-5b2eae06-fd3e-4aff-80d2-7df8eb93cd5e tempest-TestMinimumBasicScenario-1717942308 tempest-TestMinimumBasicScenario-1717942308-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1093 time: 0.1318603 Nov 15 17:57:32.568440 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34092) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:32.573063 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'port_id': 'ef009656-31c1-4948-9072-989fa7241e3b', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'fixed_ip_address': '172.20.0.4'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:32.600280 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for floatingip, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:32.611398 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de64c51c-a993-4c0a-9406-6ca83c1ed12d req-625a0a4e-7cb4-4031-a49b-f926593413f3 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:32.612864 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-de64c51c-a993-4c0a-9406-6ca83c1ed12d req-625a0a4e-7cb4-4031-a49b-f926593413f3 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0522883 Nov 15 17:57:32.664937 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-de64c51c-a993-4c0a-9406-6ca83c1ed12d req-d8b050bd-0de6-4d47-8f28-69e908a14f28 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453486 Nov 15 17:57:32.702971 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:32.816424 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_common [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Allocated IP 172.27.0.166 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/da0f30b9-3d29-4b01-bd2a-90d7af4d273d) {{(pid=108142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:57:32.922900 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for port, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:32.964304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.004361 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:57:33.007410 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.base_scheduler [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Resources bound (agent type, host, resource id): {{(pid=108142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:57:33.011059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Received port after_create {{(pid=108142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:57:33.016495 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'Port': ['ID=da0f30b9-3d29-4b01-bd2a-90d7af4d273d,revision_number=1']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:33.108349 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9fcf8ae5-253a-48a5-93ab-1b2e05165328 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.352172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.422760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.576752 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for port, precommit_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.583435 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59364862'] for port, after_update {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.648694 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'Port': ['ID=da0f30b9-3d29-4b01-bd2a-90d7af4d273d,revision_number=2']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:33.664931 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:33.761894 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Floating IP 750b6884-aae0-448b-ad09-8c96476d5166 associated. External IP: 172.27.0.166, port: ef009656-31c1-4948-9072-989fa7241e3b. Nov 15 17:57:33.783125 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6982dce6-9a37-414e-8a0a-012f98d207f5 req-505a0f6e-3682-4dc8-b56f-4c0f515bc495 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:33.784682 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6982dce6-9a37-414e-8a0a-012f98d207f5 req-505a0f6e-3682-4dc8-b56f-4c0f515bc495 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0500581 Nov 15 17:57:33.837914 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6982dce6-9a37-414e-8a0a-012f98d207f5 req-9aae2313-b7e5-40d3-9d46-36cce04040ab tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468178 Nov 15 17:57:33.963853 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Router 584aa81d-01fd-4562-8c25-b74e291f924b has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:57:34.070194 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:57:34.080765 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Sync routers for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:57:34.090095 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.090777 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:57:34.091384 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:57:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:34.118324 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-86c62978-2f9f-4692-8ec0-70792d06e962 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5487027 Nov 15 17:57:34.119251 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:34.121396 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34096) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.125003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a5d7fcd-a4e7-420f-8316-170bde054e68" -d '{"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:34.126769 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-478696896', 'description': 'tempest-secgroup-smoke-478696896 description', 'project_id': '6178223d48944b6ba503c95dcdaa1089'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.153204 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.204110 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:57:34.236081 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.242236 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.274443 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.278742 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1529937 Nov 15 17:57:34.279212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34100) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.283848 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.289707 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroup': ['ID=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:34.302975 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.303465 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.303923 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.304341 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.304759 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.305175 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.305589 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.306022 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.306431 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.307467 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.307467 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.307467 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3130b8-340b-4bd0-b098-00637026e2a0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:57:34.331907 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.332232 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79e5d873-e20e-4ee3-b685-343b2a8de74c x-openstack-request-id: req-79e5d873-e20e-4ee3-b685-343b2a8de74c {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:34.332523 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:34.333057 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-79e5d873-e20e-4ee3-b685-343b2a8de74c {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:34.333517 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:57:34.381003 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.387003 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.401124 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-10ea720c-1299-40e0-bda8-a90cbb5bfa22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:34.402663 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-10ea720c-1299-40e0-bda8-a90cbb5bfa22 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1098 time: 0.0469279 Nov 15 17:57:34.405834 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb9ab83c-3cce-47ab-93f7-521ee732cc1a,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:34.415587 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.419490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-fa0e6776-0601-4e6d-9cf7-8313f7d9ba9f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1367211 Nov 15 17:57:34.419765 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34102) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.424092 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.458626 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '750b6884-aae0-448b-ad09-8c96476d5166', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'port_id': 'ef009656-31c1-4948-9072-989fa7241e3b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'mac_address': 'fa:16:3e:a7:e6:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:33Z', 'updated_at': '2021-11-15T17:57:33Z', 'revision_number': 0, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:34.492001 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Checking router: 584aa81d-01fd-4562-8c25-b74e291f924b for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:57:34.507903 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.508136 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.509363 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:57:34.510116 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:57:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:34.541426 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-7fdd18d2-9a8c-4afc-bfed-f261f443f982 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:34.542907 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-7fdd18d2-9a8c-4afc-bfed-f261f443f982 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.1329703 Nov 15 17:57:34.608762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.615849 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.620167 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:57:34.633035 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-697697a1-fd7d-4c6c-afd8-7bf13f5b5922 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 999 time: 0.0791550 Nov 15 17:57:34.639369 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d2f3fd42-0c1e-4b10-879a-0114993ddfd6,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:34.653343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.657171 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a7a0120f-6ead-40af-9f34-4638b10c4c05 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2338102 Nov 15 17:57:34.657503 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34104) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.662132 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.689806 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.701486 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-54359523-2aea-43a6-9922-b2f7a66e288c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:34.703028 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-54359523-2aea-43a6-9922-b2f7a66e288c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0611274 Nov 15 17:57:34.749987 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.753731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-f0ecaa84-548d-4e6e-802e-6c4d645ff4db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:34.755217 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.755481 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-f0ecaa84-548d-4e6e-802e-6c4d645ff4db service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444725 Nov 15 17:57:34.773727 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=69feb102-5706-444f-b160-0df4c5dd31c4,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:34.783046 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.784296 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d7d7a176-647e-4a7b-b561-17b9d8eb7b12 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1257877 Nov 15 17:57:34.787152 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34106) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.791593 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.818711 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.859355 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-7abd77e2-1711-4137-8568-a1ff4d0b01e5 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960772 Nov 15 17:57:34.878622 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '750b6884-aae0-448b-ad09-8c96476d5166', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'port_id': 'ef009656-31c1-4948-9072-989fa7241e3b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'mac_address': 'fa:16:3e:a7:e6:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:33Z', 'updated_at': '2021-11-15T17:57:33Z', 'revision_number': 0, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:34.883940 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.890311 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.912139 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2c3a17ff-b3fb-49f3-a915-a73716c8c131,revision_number=0']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:34.912398 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ca186ec-88ab-41c9-8f8d-645475369710 None None] The sync data for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi is: [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '750b6884-aae0-448b-ad09-8c96476d5166', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'port_id': 'ef009656-31c1-4948-9072-989fa7241e3b', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'mac_address': 'fa:16:3e:a7:e6:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:33Z', 'updated_at': '2021-11-15T17:57:33Z', 'revision_number': 0, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:57:34.923276 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:34.924923 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-f91e427d-8b2e-4eb9-aa0f-208e750be9bc tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1368260 Nov 15 17:57:34.930651 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34110) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:34.935393 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:34.975715 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c087994-1920-4685-af46-74bbe8ed0654 req-d4a97f58-aa7f-4747-a9d4-a622f77d6184 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:34.977283 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3c087994-1920-4685-af46-74bbe8ed0654 req-d4a97f58-aa7f-4747-a9d4-a622f77d6184 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0503421 Nov 15 17:57:34.980511 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.securitygroups_db [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Project 6178223d48944b6ba503c95dcdaa1089 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:57:34.997141 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.020449 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-5a5d7fcd-a4e7-420f-8316-170bde054e68 req-5a91efd7-6502-4040-9835-cf714ed73a1d service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1521924 Nov 15 17:57:35.036719 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3c087994-1920-4685-af46-74bbe8ed0654 req-74353085-7dcb-45d3-bd39-2ba8c5dba2a2 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529916 Nov 15 17:57:35.068241 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.072422 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.089629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=270fa4cd-600c-45de-92f1-94a158409b68,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:35.100141 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.101341 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-47470d5e-0be4-4bef-98a2-9e0198ae628c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1696115 Nov 15 17:57:35.104338 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34112) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:35.109306 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.v2.base [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'security_group_rule': {'security_group_id': '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58', 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:35.133929 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.securitygroups_db [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Project 6178223d48944b6ba503c95dcdaa1089 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 17:57:35.137724 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbe2a128-0f6e-481d-9b13-f27eebeba1cb None None] New status for floating IP 750b6884-aae0-448b-ad09-8c96476d5166: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:57:35.139511 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.197882 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.201486 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3770926'] for security_group_rule, after_create {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.220524 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=180fa3c3-ea85-4915-907d-0a29e38c3ef7,revision_number=0']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:35.226277 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.230644 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-80c33f66-87f5-48a5-8326-400860e14ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1220043 Nov 15 17:57:35.327187 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-24484796-5a57-4dd9-8942-bb704ab51103 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-478696896&fields=id&tenant_id=6178223d48944b6ba503c95dcdaa1089 HTTP/1.1" status: 200 len: 267 time: 0.0495918 Nov 15 17:57:35.385367 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-2fd558d2-a590-4c51-9017-5dcdb7c93ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:35.386841 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-2fd558d2-a590-4c51-9017-5dcdb7c93ff0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0538921 Nov 15 17:57:35.398328 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'port': {'security_groups': ['5aea9168-36ea-4859-8653-eac99ba3fb1f', '03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58']}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:35.465759 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.601879 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.686185 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:35.722554 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.728263 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.742079 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:57:35.773843 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:35.774479 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:35.775964 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-9fc52aa6-e608-4579-beb9-c46e868da1de req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "PUT /v2.0/ports/ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 981 time: 0.3825822 Nov 15 17:57:35.776420 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:35.778711 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e" -d '{"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:35.803947 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2da241-83d0-46ea-a17c-259c43a3c471 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=6']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:35.846551 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6e906bf-a1b7-4bd3-b1f1-2583287c1cf2 x-openstack-request-id: req-c6e906bf-a1b7-4bd3-b1f1-2583287c1cf2 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:35.846835 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:35.847081 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c6e906bf-a1b7-4bd3-b1f1-2583287c1cf2 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:35.847456 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:57:35.886066 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:57:35.928059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-58bb5c86-c860-48bc-8858-4828732861a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:35.929700 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-58bb5c86-c860-48bc-8858-4828732861a7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1137 time: 0.0490551 Nov 15 17:57:35.931392 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5992a342-66ee-4d07-9375-7741d916d860 req-96ace604-be28-4007-8cf7-c23a42c06307 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:35.933060 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5992a342-66ee-4d07-9375-7741d916d860 req-96ace604-be28-4007-8cf7-c23a42c06307 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0610476 Nov 15 17:57:36.008290 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5992a342-66ee-4d07-9375-7741d916d860 req-86b1336c-489e-48f4-b6ab-42eefe7f583a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0675986 Nov 15 17:57:36.036285 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-942e4dcb-e333-45bd-bf50-1f6a5224bdf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:36.037844 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-942e4dcb-e333-45bd-bf50-1f6a5224bdf4 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.0997815 Nov 15 17:57:36.151951 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-a644fcea-a039-4724-9a06-fd5481698a39 None None] Provisioning complete for port ef009656-31c1-4948-9072-989fa7241e3b triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:57:36.152334 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-a644fcea-a039-4724-9a06-fd5481698a39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:36.158382 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5055cc-1803-4b3c-b525-920d4e234004 req-969d9b2e-a576-467c-be2f-7e64a7bac95f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:36.160009 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f5055cc-1803-4b3c-b525-920d4e234004 req-969d9b2e-a576-467c-be2f-7e64a7bac95f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0542052 Nov 15 17:57:36.219434 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7f5055cc-1803-4b3c-b525-920d4e234004 req-b3b2899d-a4bd-487a-bb87-6cbb87ed709b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525970 Nov 15 17:57:36.389872 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-2b472ed0-4dd2-4eb0-9238-011a63ac62c4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 1001 time: 0.3432567 Nov 15 17:57:36.440278 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-0baec6cf-49da-4014-9511-d0a7f6f2c589 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:36.441715 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-0baec6cf-49da-4014-9511-d0a7f6f2c589 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0430663 Nov 15 17:57:36.491419 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-ee181a72-b1a7-4c31-90c3-84d94b70b266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:36.492950 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-ee181a72-b1a7-4c31-90c3-84d94b70b266 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415959 Nov 15 17:57:36.597742 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-afeec0ff-3209-45a6-9598-2e28928007c5 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944214 Nov 15 17:57:36.665402 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:36.690130 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-b0219e60-cfb6-49f8-93a8-c4ac3521a63e req-652828c7-eac5-44d6-a5b8-80b1eccaebcd service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842476 Nov 15 17:57:37.354928 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48f1b4e-1fa5-4e85-8df0-6a411558fa07 req-a51a94e0-c19b-402c-b8df-501cb756d6ad tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:37.356405 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e48f1b4e-1fa5-4e85-8df0-6a411558fa07 req-a51a94e0-c19b-402c-b8df-501cb756d6ad tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0572307 Nov 15 17:57:37.421009 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e48f1b4e-1fa5-4e85-8df0-6a411558fa07 req-722178ac-7cb5-4fd1-91b2-8cf02c50fd01 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550311 Nov 15 17:57:38.543951 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af3a5508-4da7-432e-aac0-0faed3b7a15a req-a3e740e8-67b3-4c96-8758-7a50630886b6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:38.545423 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af3a5508-4da7-432e-aac0-0faed3b7a15a req-a3e740e8-67b3-4c96-8758-7a50630886b6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0514235 Nov 15 17:57:38.598390 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-af3a5508-4da7-432e-aac0-0faed3b7a15a req-82a29374-bd67-4afd-bbc2-ee4788ff481a tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446799 Nov 15 17:57:39.730552 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d59cee-faa7-4605-a7d6-a72b3adb3bd8 req-d3a38059-ca5e-400d-a18b-87148cb6102b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:39.732042 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a7d59cee-faa7-4605-a7d6-a72b3adb3bd8 req-d3a38059-ca5e-400d-a18b-87148cb6102b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 943 time: 0.0524230 Nov 15 17:57:39.784653 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a7d59cee-faa7-4605-a7d6-a72b3adb3bd8 req-36fb1dc5-33ea-4ec1-ab5f-f4bc2daca9a6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443358 Nov 15 17:57:39.907877 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device d86b2d7c-54b7-4f20-ae69-6c89d42fea89 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:57:40.003835 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:40.014809 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'port_id': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'mac_address': 'fa:16:3e:31:4f:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 430, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:57:40.056046 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:40.068620 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d86b2d7c-54b7-4f20-ae69-6c89d42fea89 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:57:40.087457 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:40.094309 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:40.139966 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=4']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:40.347935 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['d86b2d7c-54b7-4f20-ae69-6c89d42fea89'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:57:40.924619 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae23f1b-8a71-497e-acda-d1c8361f5517 req-fc3a5d3d-3ce3-4cc8-99c9-d56f2363552d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:40.925998 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eae23f1b-8a71-497e-acda-d1c8361f5517 req-fc3a5d3d-3ce3-4cc8-99c9-d56f2363552d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 944 time: 0.0590639 Nov 15 17:57:40.978818 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-eae23f1b-8a71-497e-acda-d1c8361f5517 req-ebae6faa-2104-46a8-900b-79b9585e3ce6 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438321 Nov 15 17:57:41.932755 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device d86b2d7c-54b7-4f20-ae69-6c89d42fea89 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:57:41.989384 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning for port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 completed by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 17:57:41.995932 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:57:41.996484 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:42.079242 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:42.100883 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671ed25e-3659-4b70-80e6-7626c867183c req-560f4796-3135-45dc-bbb3-94af847f52ad tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:42.102419 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-671ed25e-3659-4b70-80e6-7626c867183c req-560f4796-3135-45dc-bbb3-94af847f52ad tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 944 time: 0.0517268 Nov 15 17:57:42.103182 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:42.105508 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf16db9c-a8fc-43bf-b953-4e93a415c2cd" -d '{"events": [{"server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "name": "network-vif-plugged", "status": "completed", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:42.118815 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:57:42.125484 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:42.153099 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b15b3340-351d-44b4-bea4-bde283684f4a x-openstack-request-id: req-b15b3340-351d-44b4-bea4-bde283684f4a {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:42.153434 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "name": "network-vif-plugged", "status": "completed", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:42.153643 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b15b3340-351d-44b4-bea4-bde283684f4a {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:42.154030 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'code': 200} Nov 15 17:57:42.159775 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-671ed25e-3659-4b70-80e6-7626c867183c req-9fa0ed59-48d1-4e4d-a0aa-c21e0a1c0aef tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471940 Nov 15 17:57:42.181734 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=5']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:42.407393 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc9ce83-9dac-4e4e-9fd9-7af214dedc19 req-2fb8be04-0d20-4cec-9b60-5d40d2584a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:42.409613 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ccc9ce83-9dac-4e4e-9fd9-7af214dedc19 req-2fb8be04-0d20-4cec-9b60-5d40d2584a1b service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1098 time: 0.0488212 Nov 15 17:57:42.460817 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-ccc9ce83-9dac-4e4e-9fd9-7af214dedc19 req-9629d01c-057a-4364-b6d6-1d9f954ba570 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423000 Nov 15 17:57:43.293901 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f5efd1-4a1f-40f7-ade4-6098ce5fe73f req-6c9bc26e-bd46-4987-8317-a5d9f60da463 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:43.295396 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86f5efd1-4a1f-40f7-ade4-6098ce5fe73f req-6c9bc26e-bd46-4987-8317-a5d9f60da463 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0513883 Nov 15 17:57:43.345629 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-86f5efd1-4a1f-40f7-ade4-6098ce5fe73f req-7a8eaf62-28a6-4665-89a2-4caed34ea262 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440583 Nov 15 17:57:44.468644 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727ff8f5-ca94-4aa0-8c73-22a830290f6c req-5086fa98-3751-4ac4-9c7c-8d0f957c921b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:44.470181 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-727ff8f5-ca94-4aa0-8c73-22a830290f6c req-5086fa98-3751-4ac4-9c7c-8d0f957c921b tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0565934 Nov 15 17:57:44.525879 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-727ff8f5-ca94-4aa0-8c73-22a830290f6c req-d012549a-8542-4eca-9585-bdae3f251994 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472345 Nov 15 17:57:44.648291 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a715a30-d950-477d-ab59-95ef0b35ae1e req-94e644c5-34fd-48df-9029-6a6b01353082 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:44.649648 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0a715a30-d950-477d-ab59-95ef0b35ae1e req-94e644c5-34fd-48df-9029-6a6b01353082 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0548601 Nov 15 17:57:44.704985 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0a715a30-d950-477d-ab59-95ef0b35ae1e req-be661891-3bd1-44fe-81b2-5138eb32f8b7 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492384 Nov 15 17:57:44.729529 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34144) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:44.774146 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05f33729-ec7d-49e8-98cd-b6917a325345 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:44.775616 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-05f33729-ec7d-49e8-98cd-b6917a325345 tempest-TestVolumeBootPattern-1406352172 tempest-TestVolumeBootPattern-1406352172-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1093 time: 0.0449467 Nov 15 17:57:44.780132 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34146) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:57:44.786863 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Request body: {'floatingip': {'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'port_id': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address': '172.20.0.5'}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:57:44.812206 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:44.912309 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:45.014207 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_common [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Allocated IP 172.27.0.60 (5536583f-f2fb-4579-9b55-62f8818c8ea0/cd734db9-2a5e-4bf6-98ea-2ce68d800b8c/01f658e3-fcdd-4a44-bce9-54b31f55f3a0) {{(pid=108141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 17:57:45.124235 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:45.159683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762238340518', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:45.199248 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Network 5536583f-f2fb-4579-9b55-62f8818c8ea0 is already hosted by enough agents. {{(pid=108141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 17:57:45.202116 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.base_scheduler [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Resources bound (agent type, host, resource id): {{(pid=108141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 17:57:45.205776 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Received port after_create {{(pid=108141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 17:57:45.211508 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=01f658e3-fcdd-4a44-bce9-54b31f55f3a0,revision_number=1']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:45.787406 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:45.855315 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:46.003030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:46.009484 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:46.072676 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event updated for resources: {'Port': ['ID=01f658e3-fcdd-4a44-bce9-54b31f55f3a0,revision_number=2']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:57:46.087236 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3753393'] for floatingip, after_create {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:46.183549 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 236d8684-fd8f-4578-a1f2-0d356f6d00fb associated. External IP: 172.27.0.60, port: d86b2d7c-54b7-4f20-ae69-6c89d42fea89. Nov 15 17:57:46.398128 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:57:46.514024 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:57:46.525286 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:57:46.537550 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:46.543218 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:57:46.543859 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:57:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:46.565478 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-450e1797-dfad-4891-8ea1-b8cbe006b308 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7840958 Nov 15 17:57:46.566074 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:57:46.568449 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f170f08a-5a6d-4788-9066-9031f3bc8590" -d '{"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:57:46.606499 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:57:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-863c3f9c-5e67-43bb-8f28-b1ad02da0a57 x-openstack-request-id: req-863c3f9c-5e67-43bb-8f28-b1ad02da0a57 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:57:46.606791 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:57:46.607047 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-863c3f9c-5e67-43bb-8f28-b1ad02da0a57 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:57:46.607444 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'status': 'completed', 'code': 200} Nov 15 17:57:46.646371 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:57:46.671599 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-69914709-4d85-4466-83e3-f9f9c2af9392 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:46.673124 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-69914709-4d85-4466-83e3-f9f9c2af9392 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1098 time: 0.0407252 Nov 15 17:57:46.767646 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-99ae55bf-70bc-4979-814c-f469ac0e961a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:46.769153 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-99ae55bf-70bc-4979-814c-f469ac0e961a service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.0867341 Nov 15 17:57:46.834095 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-a5e9bbc6-228a-4757-9843-d55f8a483f65 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 200 len: 998 time: 0.0574508 Nov 15 17:57:46.876205 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '236d8684-fd8f-4578-a1f2-0d356f6d00fb', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.60', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:31:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:45Z', 'updated_at': '2021-11-15T17:57:45Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}, {'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:46.882605 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-8e3e573e-9931-45ee-8808-3f21c6346744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:46.884101 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-8e3e573e-9931-45ee-8808-3f21c6346744 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0432494 Nov 15 17:57:46.902758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:57:46.912120 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:57:46.912762 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:57:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:46.932113 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-48f96920-3b55-48bc-bc9b-d7130c005425 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:46.933605 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-48f96920-3b55-48bc-bc9b-d7130c005425 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424943 Nov 15 17:57:47.019745 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:57:47.024591 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-c342efe5-28aa-4918-8182-90d2409e2606 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819643 Nov 15 17:57:47.118932 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-f170f08a-5a6d-4788-9066-9031f3bc8590 req-bd21ba24-b19d-48c9-a571-5b7d7b5a8b80 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872979 Nov 15 17:57:47.251742 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '236d8684-fd8f-4578-a1f2-0d356f6d00fb', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.60', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:31:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:45Z', 'updated_at': '2021-11-15T17:57:45Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}, {'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:57:47.277101 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef78f75-4d78-4099-9e2d-71c862e4b728 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '236d8684-fd8f-4578-a1f2-0d356f6d00fb', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.60', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:31:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:57:45Z', 'updated_at': '2021-11-15T17:57:45Z', 'revision_number': 0, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}, {'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:57:47.473110 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4b7355-c9e6-44b8-9595-3eac7b54cc1f None None] New status for floating IP 236d8684-fd8f-4578-a1f2-0d356f6d00fb: ACTIVE {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:57:52.429427 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:57:58.545540 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63060fac-c6c2-4582-8e42-d7a5da79d7dd req-44b47ed6-d4d7-4c19-b506-c112317a30db tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:58.547068 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-63060fac-c6c2-4582-8e42-d7a5da79d7dd req-44b47ed6-d4d7-4c19-b506-c112317a30db tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0529356 Nov 15 17:57:58.552209 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-35fa94ec-ccdc-4d36-ba5e-552a64b8e0c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:58.553798 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-35fa94ec-ccdc-4d36-ba5e-552a64b8e0c8 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1137 time: 0.0432062 Nov 15 17:57:58.606439 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-63060fac-c6c2-4582-8e42-d7a5da79d7dd req-ada59ccf-f7bb-4785-bacd-68ab94eecd32 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0530972 Nov 15 17:57:58.649207 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-c61b39d3-784a-4515-a946-8675d967fb4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:58.650845 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-c61b39d3-784a-4515-a946-8675d967fb4d service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.0898967 Nov 15 17:57:58.718510 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-5da54c7a-6de9-4f3d-9bc0-05a5159f369b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 1001 time: 0.0585585 Nov 15 17:57:58.780816 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-6ce63ae6-b793-4eaa-bda6-09de41e75440 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:58.782633 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-6ce63ae6-b793-4eaa-bda6-09de41e75440 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0544925 Nov 15 17:57:58.841632 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-93ed7bd0-472b-491d-8c04-f7e0d9844853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:58.843090 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-93ed7bd0-472b-491d-8c04-f7e0d9844853 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0501812 Nov 15 17:57:58.935237 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-242e2fe4-53b0-4e36-9c16-260304b5dc8e service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826943 Nov 15 17:57:59.049340 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-16eb22b3-e828-4610-8188-af16d77c96c1 req-d1e1d860-2848-498d-98b2-f2c3b1f0e5c5 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947871 Nov 15 17:57:59.059359 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:57:59.735300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0662329-53a3-4a09-861f-e788fa2cc7af req-30c7759f-0356-484d-9008-366f9c07926e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:57:59.736814 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0662329-53a3-4a09-861f-e788fa2cc7af req-30c7759f-0356-484d-9008-366f9c07926e tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0512021 Nov 15 17:57:59.798039 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-a0662329-53a3-4a09-861f-e788fa2cc7af req-2f2760ad-3653-41dc-b88f-deb4c80821f5 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0544176 Nov 15 17:58:00.814399 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-bf861259-9b3a-42c2-a89c-38d56c1b36bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:00.928321 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255adc05-49ce-4ee0-89e0-8fe4ebaa4059 req-f190ca99-0908-4320-8f15-cd30823308fa tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:00.929988 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-255adc05-49ce-4ee0-89e0-8fe4ebaa4059 req-f190ca99-0908-4320-8f15-cd30823308fa tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0628359 Nov 15 17:58:00.991020 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-255adc05-49ce-4ee0-89e0-8fe4ebaa4059 req-63a05949-418f-498b-88de-c6252f75a2e9 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0545835 Nov 15 17:58:02.135848 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c97260d-83aa-411c-bef3-5e369ce01868 req-5ab0da89-849a-4336-9ffa-b7fcbdf4913d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:02.137316 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6c97260d-83aa-411c-bef3-5e369ce01868 req-5ab0da89-849a-4336-9ffa-b7fcbdf4913d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0629327 Nov 15 17:58:02.204039 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6c97260d-83aa-411c-bef3-5e369ce01868 req-f2d4d61b-65d3-4378-8753-117219bd5ccb tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0572839 Nov 15 17:58:03.113168 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-65004f62-2530-4dc5-9401-b336b387f7a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:03.337441 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223aa1b8-b57b-4d61-a635-83f06b93e6b1 req-7630b6a8-b935-4b86-8a29-a91530164a4c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:03.338843 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-223aa1b8-b57b-4d61-a635-83f06b93e6b1 req-7630b6a8-b935-4b86-8a29-a91530164a4c tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0538990 Nov 15 17:58:03.404081 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-223aa1b8-b57b-4d61-a635-83f06b93e6b1 req-ceca49e5-8e99-4482-b6a4-af059a4e5f60 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0577986 Nov 15 17:58:04.497183 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:04.530218 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e033c8-4b66-4946-bcba-a3815474ab25 req-a472c116-f659-48ab-bbd9-af7f509ab542 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:04.531656 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74e033c8-4b66-4946-bcba-a3815474ab25 req-a472c116-f659-48ab-bbd9-af7f509ab542 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0508225 Nov 15 17:58:04.590798 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74e033c8-4b66-4946-bcba-a3815474ab25 req-927337ef-c158-4be8-b808-826bf4047bb0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0528724 Nov 15 17:58:05.606749 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:05.712814 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c67e65-796e-428c-ac90-1a18ec51dd9f req-b133d68d-93cf-468f-8e32-fb8e43641f5a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:05.714426 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-91c67e65-796e-428c-ac90-1a18ec51dd9f req-b133d68d-93cf-468f-8e32-fb8e43641f5a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0529234 Nov 15 17:58:05.778435 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-91c67e65-796e-428c-ac90-1a18ec51dd9f req-dff38962-aea6-46ee-bacc-d012385f52ab tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0568516 Nov 15 17:58:06.673187 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:06.921986 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e7b61f-c849-4c57-b65c-4f69fbffd777 req-87181f47-1ac1-4fa4-a7d2-1372231e22d6 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:06.923353 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-07e7b61f-c849-4c57-b65c-4f69fbffd777 req-87181f47-1ac1-4fa4-a7d2-1372231e22d6 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0656950 Nov 15 17:58:06.988092 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-07e7b61f-c849-4c57-b65c-4f69fbffd777 req-64709ed0-1dfb-420e-8b22-8827f3f26169 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0554276 Nov 15 17:58:08.109098 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e659b7f7-7781-4324-932d-560ee4b33f24 req-705ea8ce-fefb-47f3-b9a6-6f4aa2d9d769 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:08.110571 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e659b7f7-7781-4324-932d-560ee4b33f24 req-705ea8ce-fefb-47f3-b9a6-6f4aa2d9d769 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0528591 Nov 15 17:58:08.173890 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e659b7f7-7781-4324-932d-560ee4b33f24 req-744872f7-c893-4e86-9890-0f122974c1b3 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0540791 Nov 15 17:58:09.322638 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d40e6f6-255d-468f-b4db-c46662fa7a12 req-ccbe36ef-a6e6-4b58-8ea6-9f48cd5351b7 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:09.324238 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d40e6f6-255d-468f-b4db-c46662fa7a12 req-ccbe36ef-a6e6-4b58-8ea6-9f48cd5351b7 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0680625 Nov 15 17:58:09.391065 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0d40e6f6-255d-468f-b4db-c46662fa7a12 req-31577066-6a6b-4b29-9df5-5caef63f3865 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0602670 Nov 15 17:58:10.511411 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513b03fd-49c3-42f7-ab85-396d83941b15 req-9f906f69-13e7-4ede-8c68-6278ff2a4027 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:10.512883 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-513b03fd-49c3-42f7-ab85-396d83941b15 req-9f906f69-13e7-4ede-8c68-6278ff2a4027 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0499406 Nov 15 17:58:10.576225 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-513b03fd-49c3-42f7-ab85-396d83941b15 req-429d4fac-16fd-40fa-b25c-c36ec9d764fa tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0541279 Nov 15 17:58:11.698161 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138b06c6-8f3c-459d-bfc2-0a8453fcd6ee req-0c4773b5-236a-4320-899f-799bf1e13b6a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:11.699668 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-138b06c6-8f3c-459d-bfc2-0a8453fcd6ee req-0c4773b5-236a-4320-899f-799bf1e13b6a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0552676 Nov 15 17:58:11.769798 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-138b06c6-8f3c-459d-bfc2-0a8453fcd6ee req-90ea3016-1dcd-4315-b2bc-73a11f3b0515 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0635178 Nov 15 17:58:12.909173 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607aee38-39d4-46f5-82ff-106ee042c276 req-4a59125e-8843-47fe-b81a-568c686233b5 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:12.910632 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-607aee38-39d4-46f5-82ff-106ee042c276 req-4a59125e-8843-47fe-b81a-568c686233b5 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0577083 Nov 15 17:58:12.973609 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-607aee38-39d4-46f5-82ff-106ee042c276 req-84f67164-a851-45dd-a0c5-a4eed2a58bea tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0539920 Nov 15 17:58:14.211422 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35345204-5b76-4ffc-a8fe-317ed3ccaa05 req-98575f81-d7d7-400b-9f25-80a94653f2e9 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:14.212914 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-35345204-5b76-4ffc-a8fe-317ed3ccaa05 req-98575f81-d7d7-400b-9f25-80a94653f2e9 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.1646788 Nov 15 17:58:14.278250 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-35345204-5b76-4ffc-a8fe-317ed3ccaa05 req-33a3618a-34a6-4538-bab3-b8ee287b1cf0 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0562069 Nov 15 17:58:15.461647 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3117cbe4-5b5d-4439-965a-62850885abd6 req-0c05d7ac-7be7-43df-b171-43855fb5cf87 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:15.463362 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3117cbe4-5b5d-4439-965a-62850885abd6 req-0c05d7ac-7be7-43df-b171-43855fb5cf87 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.1066206 Nov 15 17:58:15.525344 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-3117cbe4-5b5d-4439-965a-62850885abd6 req-5ceb5a6c-5fdd-452d-ab7d-5e6f99a806cb tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&id=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0539370 Nov 15 17:58:22.427114 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:27.083476 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b45d6f-6201-4205-9244-b77e503659c1 req-a1e3d797-d9f0-4ded-bb20-ff083e5a1ec1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:27.085019 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-33b45d6f-6201-4205-9244-b77e503659c1 req-a1e3d797-d9f0-4ded-bb20-ff083e5a1ec1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0518911 Nov 15 17:58:27.140490 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-33b45d6f-6201-4205-9244-b77e503659c1 req-f8c57edf-3699-4f2d-9b1b-b7ead1cd060b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475841 Nov 15 17:58:28.271732 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f571ff-5511-41d4-a6a9-aed17c82eb28 req-e5ab1c9c-e47a-4d37-971f-1e969beeb589 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:28.273207 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f571ff-5511-41d4-a6a9-aed17c82eb28 req-e5ab1c9c-e47a-4d37-971f-1e969beeb589 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0505416 Nov 15 17:58:28.330326 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49f571ff-5511-41d4-a6a9-aed17c82eb28 req-ca82feda-3495-4dca-8e98-c2355dc1ee0d tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483041 Nov 15 17:58:28.573513 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-3aa1f399-91d4-485d-b676-67c06bf555fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:28.575109 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-3aa1f399-91d4-485d-b676-67c06bf555fc service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0436544 Nov 15 17:58:28.697604 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-4d4f8406-298c-427d-8c48-09b0cff35b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:28.699106 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-4d4f8406-298c-427d-8c48-09b0cff35b3a service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.0906587 Nov 15 17:58:28.768745 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-90c23453-4584-4235-9fe1-acbe624a600d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 1001 time: 0.0619764 Nov 15 17:58:28.825074 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-ba283fbc-20c5-4c76-a902-1fa6ea1f6c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:28.826376 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-ba283fbc-20c5-4c76-a902-1fa6ea1f6c05 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0502291 Nov 15 17:58:28.874976 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-6832f7ce-0a39-4ec8-a503-d5eaea6280ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:28.876524 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-6832f7ce-0a39-4ec8-a503-d5eaea6280ba service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424123 Nov 15 17:58:28.888047 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-859ea568-9706-4cd7-8d89-17007ecc3d07 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=108142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 17:58:28.888995 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-859ea568-9706-4cd7-8d89-17007ecc3d07 service neutron] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048912 Nov 15 17:58:28.993441 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-b33e6ca2-2a11-4f4b-a4fa-c06293381ce1 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0969162 Nov 15 17:58:29.097759 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7749b3e1-caf2-424e-84bb-515c8ec83394 req-8d65b81a-d5ee-4bf8-b504-7a781a0501cc service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971162 Nov 15 17:58:29.472693 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7160da-452e-4efb-9257-d5aa093c57c6 req-a246bb93-861c-4446-993e-fd02750021d5 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:29.474181 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b7160da-452e-4efb-9257-d5aa093c57c6 req-a246bb93-861c-4446-993e-fd02750021d5 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0552719 Nov 15 17:58:29.526769 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-7b7160da-452e-4efb-9257-d5aa093c57c6 req-1ab168f2-c7ec-49be-b94f-24a5541eff42 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436847 Nov 15 17:58:30.656543 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ddcc41-41df-42ec-bb8d-5cbc250561c6 req-5d279ed1-8136-495f-9d9b-bf7e3b04111e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:30.658078 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49ddcc41-41df-42ec-bb8d-5cbc250561c6 req-5d279ed1-8136-495f-9d9b-bf7e3b04111e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0578928 Nov 15 17:58:30.711087 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-49ddcc41-41df-42ec-bb8d-5cbc250561c6 req-a302bb10-3b88-4544-845f-617d36165898 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460074 Nov 15 17:58:30.812726 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1bca7804-7f49-4c65-9501-a0c1f1a0fb9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:31.850282 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40982d0e-035e-47b4-9648-a0fa6dc797cb req-b3697c0e-d8d5-4f66-878e-e2b7e2d0307f tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:31.851833 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-40982d0e-035e-47b4-9648-a0fa6dc797cb req-b3697c0e-d8d5-4f66-878e-e2b7e2d0307f tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0537190 Nov 15 17:58:31.904930 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-40982d0e-035e-47b4-9648-a0fa6dc797cb req-367ba7a7-3ef5-4f7a-83d9-e15ac0fcf05e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470936 Nov 15 17:58:33.041912 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191375fb-e14f-4d3b-9310-06a37d830a98 req-d6f81884-cfed-4cb5-976f-69a0303bb165 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:33.043375 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-191375fb-e14f-4d3b-9310-06a37d830a98 req-d6f81884-cfed-4cb5-976f-69a0303bb165 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0555923 Nov 15 17:58:33.095118 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-191375fb-e14f-4d3b-9310-06a37d830a98 req-3302b43d-b816-40f6-acf3-448be6986119 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442455 Nov 15 17:58:33.117587 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ef15f797-14ca-4ca7-a0ca-8d1d80e9fb31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:34.216180 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5763fc77-0521-406a-8485-f8af8d8ad5ee req-47035038-a60d-45a0-82e0-3d71c66e7bbb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:34.217670 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5763fc77-0521-406a-8485-f8af8d8ad5ee req-47035038-a60d-45a0-82e0-3d71c66e7bbb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0500541 Nov 15 17:58:34.269215 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-5763fc77-0521-406a-8485-f8af8d8ad5ee req-de629285-b7a2-4e34-823e-0e840b8f4da4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454254 Nov 15 17:58:34.501231 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:35.417175 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89122249-6da3-4fa6-b6a6-556adf07ce04 req-0c6a2718-df22-4406-9095-a353e074df84 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:35.418672 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-89122249-6da3-4fa6-b6a6-556adf07ce04 req-0c6a2718-df22-4406-9095-a353e074df84 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0624630 Nov 15 17:58:35.472222 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-89122249-6da3-4fa6-b6a6-556adf07ce04 req-611f554a-4ac9-4e02-a41c-54f64bfa381b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472300 Nov 15 17:58:35.615424 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:36.063291 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:58:36.603595 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd3f64e-8f36-49bf-8118-2a07483d22e8 req-9c3837fd-4beb-40bf-874f-4aaec63e1c31 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:36.605107 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-acd3f64e-8f36-49bf-8118-2a07483d22e8 req-9c3837fd-4beb-40bf-874f-4aaec63e1c31 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0523841 Nov 15 17:58:36.653725 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-acd3f64e-8f36-49bf-8118-2a07483d22e8 req-da8421be-8114-4579-ae87-da3d0236c8ee tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426896 Nov 15 17:58:36.670749 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:37.291023 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-e2ab39df-49e2-4938-a9b9-d955a9a92e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:37.292550 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-e2ab39df-49e2-4938-a9b9-d955a9a92e3c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0891042 Nov 15 17:58:37.387237 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-47f7f7f5-ad48-4435-8d47-03c538cf2568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:37.388697 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-47f7f7f5-ad48-4435-8d47-03c538cf2568 service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.0885682 Nov 15 17:58:37.457509 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-94faf14c-31fa-40eb-aa88-5981f860dfdd service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 1001 time: 0.0604022 Nov 15 17:58:37.515633 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-0c3201d7-36b2-49bc-9887-ed37f428a760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:37.517040 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-0c3201d7-36b2-49bc-9887-ed37f428a760 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0519505 Nov 15 17:58:37.565015 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-7d827f7c-51df-4b8a-8c96-5b1727d63376 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:37.566461 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-7d827f7c-51df-4b8a-8c96-5b1727d63376 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418158 Nov 15 17:58:37.656749 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-c0bc13a6-3ed4-40d5-8291-24b4a9a25ecd service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823631 Nov 15 17:58:37.751210 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-56f0f903-71e7-4ae6-996c-f50cb70b2ff5 req-6e301cc4-44dd-4a2b-9faa-fcbac278bcb9 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866966 Nov 15 17:58:37.774236 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2416e88a-e0c5-472a-b04f-7c28494166be req-211f0803-4f25-4e92-a7cd-2d1134dc12a6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:37.775614 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2416e88a-e0c5-472a-b04f-7c28494166be req-211f0803-4f25-4e92-a7cd-2d1134dc12a6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0530291 Nov 15 17:58:37.834704 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2416e88a-e0c5-472a-b04f-7c28494166be req-0b2dea21-f14f-4ff7-affe-edf6dab94549 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524480 Nov 15 17:58:38.960207 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49baf64-807e-4a35-a2ee-90f7efa49272 req-9fde7c97-a9ee-471b-a186-51a3803080f8 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:38.961682 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c49baf64-807e-4a35-a2ee-90f7efa49272 req-9fde7c97-a9ee-471b-a186-51a3803080f8 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0502160 Nov 15 17:58:39.011405 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-c49baf64-807e-4a35-a2ee-90f7efa49272 req-9c4a98a3-601e-4920-a203-3f20c0b4d33a tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436940 Nov 15 17:58:40.157905 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfa0761-d8f9-44e0-a044-cea8e087c872 req-51aae850-fe36-40b2-a816-7b618863035c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:40.159569 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6dfa0761-d8f9-44e0-a044-cea8e087c872 req-51aae850-fe36-40b2-a816-7b618863035c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0608540 Nov 15 17:58:40.209264 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-6dfa0761-d8f9-44e0-a044-cea8e087c872 req-64762eca-f72c-4224-95aa-62e3bf5b1c04 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437210 Nov 15 17:58:40.426133 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71461fa3-9aa0-4964-b1c9-bc7621af89d8 req-014b55f3-b77d-4101-93b4-a58342d0e2f3 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:40.427587 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71461fa3-9aa0-4964-b1c9-bc7621af89d8 req-014b55f3-b77d-4101-93b4-a58342d0e2f3 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0495434 Nov 15 17:58:40.439195 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-76e9ea7f-88e9-469f-a304-73efc32ad793 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0835142 Nov 15 17:58:40.480439 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-71461fa3-9aa0-4964-b1c9-bc7621af89d8 req-e92ca4d8-cec6-47e1-8332-fd49c8170ef6 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465224 Nov 15 17:58:41.604744 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a538db-84b7-448e-ac7d-978a11870726 req-f4bc4df4-29d4-4862-84f7-0208b247eb3b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:41.606287 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a538db-84b7-448e-ac7d-978a11870726 req-f4bc4df4-29d4-4862-84f7-0208b247eb3b tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0513785 Nov 15 17:58:41.667158 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-73a538db-84b7-448e-ac7d-978a11870726 req-93676467-83b8-4521-8e09-59112fcde271 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546131 Nov 15 17:58:41.960627 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-5b07f2d6-181b-4004-9f38-69e25d9b4dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:41.962088 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-5b07f2d6-181b-4004-9f38-69e25d9b4dbd service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8&tenant_id=418a337f482c4773a787a5a90721966a HTTP/1.1" status: 200 len: 1098 time: 0.0429437 Nov 15 17:58:42.043150 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-fb7eff35-6673-4ce5-a275-fa9c410b1dee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:42.045320 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-fb7eff35-6673-4ce5-a275-fa9c410b1dee service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0516958 Nov 15 17:58:42.140804 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-41605e67-27cf-4176-b269-793e5afcb6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:42.142269 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-41605e67-27cf-4176-b269-793e5afcb6ab service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.0865052 Nov 15 17:58:42.150636 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:58:42.215037 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-f00c5364-0c65-4202-ab79-4dbbdc8a1522 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 1001 time: 0.0639982 Nov 15 17:58:42.230976 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:42.255927 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:58:42.258194 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-155f83b1-075b-42ea-9860-f9cfcaa13c54" -d '{"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-unplugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:58:42.269098 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-1a29d5c6-72ca-43a9-900b-f501290ca69f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:42.270619 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-1a29d5c6-72ca-43a9-900b-f501290ca69f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0438938 Nov 15 17:58:42.271385 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:42.277560 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:42.302040 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 15 Nov 2021 17:58:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9043d12-fd9d-46c7-9c2c-e9a57b98d93a x-openstack-request-id: req-a9043d12-fd9d-46c7-9c2c-e9a57b98d93a {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:58:42.302285 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-unplugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:58:42.302529 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a9043d12-fd9d-46c7-9c2c-e9a57b98d93a {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:58:42.302915 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'code': 200} Nov 15 17:58:42.317193 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-6b3fba73-8f73-4b5d-bed5-2edb29952db4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:42.318668 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-6b3fba73-8f73-4b5d-bed5-2edb29952db4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402379 Nov 15 17:58:42.327858 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=6']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:42.335163 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.335504 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.335902 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.336233 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.336555 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.336866 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.337186 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.337508 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.337829 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.338148 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.338463 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.338773 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:42.411890 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-3bff79dd-73d1-4d6f-90ea-c2ef90274dad service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844495 Nov 15 17:58:42.504426 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-80701d7b-49f8-4bdc-9cfe-3f2cd0e6fd47 req-875b7ff5-c291-4618-b9da-10f3a264a9a2 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828948 Nov 15 17:58:42.806665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68265efe-3bda-4638-823a-0869e671e4a3 req-eb050365-a242-4b85-89a9-fe0bb5928c12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:42.808058 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68265efe-3bda-4638-823a-0869e671e4a3 req-eb050365-a242-4b85-89a9-fe0bb5928c12 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0595706 Nov 15 17:58:42.866986 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68265efe-3bda-4638-823a-0869e671e4a3 req-c6f5c73e-f59f-4ae1-a96e-ca9080b342b7 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529823 Nov 15 17:58:44.008229 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9673e02-8bcd-40f9-9332-7b5c6bd6b7ee req-e8a53aea-8197-4987-bc8d-9696e2aeee27 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:44.009705 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9673e02-8bcd-40f9-9332-7b5c6bd6b7ee req-e8a53aea-8197-4987-bc8d-9696e2aeee27 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0561500 Nov 15 17:58:44.071045 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d9673e02-8bcd-40f9-9332-7b5c6bd6b7ee req-575852fb-7074-4383-a90f-f1829e9cdc19 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550389 Nov 15 17:58:45.198868 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734c80a4-9ecf-427e-b0f0-711ec498fcdd req-2c672dd6-0b70-4661-ab77-9575c6d980c1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:45.200328 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-734c80a4-9ecf-427e-b0f0-711ec498fcdd req-2c672dd6-0b70-4661-ab77-9575c6d980c1 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0536361 Nov 15 17:58:45.248604 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-734c80a4-9ecf-427e-b0f0-711ec498fcdd req-f52fd412-acd7-409a-b800-e251416f1df8 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421295 Nov 15 17:58:46.374349 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e693fea-d942-4198-9b2a-2593e9c63ee4 req-d6045d2b-2753-4454-ad9a-f532de134af0 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:46.375852 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e693fea-d942-4198-9b2a-2593e9c63ee4 req-d6045d2b-2753-4454-ad9a-f532de134af0 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0533314 Nov 15 17:58:46.429348 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-4e693fea-d942-4198-9b2a-2593e9c63ee4 req-0b3c1ae1-337b-41f0-a4cf-aebea7b41635 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451088 Nov 15 17:58:47.573606 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f92b4bf-069d-46a0-a250-a1e689b48369 req-2a912758-92f0-4c1c-8f1b-f5f28799545e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:47.575077 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f92b4bf-069d-46a0-a250-a1e689b48369 req-2a912758-92f0-4c1c-8f1b-f5f28799545e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0619879 Nov 15 17:58:47.632950 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f92b4bf-069d-46a0-a250-a1e689b48369 req-ef0c9ed5-cfd5-47a8-9783-c8e93ba7b7a7 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496838 Nov 15 17:58:48.747275 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66489fbf-8146-4b7a-b68a-f26297c6d78a req-03596f46-4e33-4204-8b74-253fa2ad4a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:48.748821 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-66489fbf-8146-4b7a-b68a-f26297c6d78a req-03596f46-4e33-4204-8b74-253fa2ad4a51 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1096 time: 0.0443347 Nov 15 17:58:48.750930 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10e68ef-c3bd-44bd-814f-776df0d2c648 req-09a95526-efaf-4d03-8a97-ce840d0e5d8a tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:48.752435 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f10e68ef-c3bd-44bd-814f-776df0d2c648 req-09a95526-efaf-4d03-8a97-ce840d0e5d8a tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0492165 Nov 15 17:58:48.797854 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-66489fbf-8146-4b7a-b68a-f26297c6d78a req-fbd87551-6a96-4b72-964b-92815433cbde service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408363 Nov 15 17:58:48.803031 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f10e68ef-c3bd-44bd-814f-776df0d2c648 req-66f7d519-059d-423a-bfa1-eb48c3f390ce tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441537 Nov 15 17:58:49.133301 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-dec8ebc2-81e0-477c-b387-363c51e60e18 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-478696896&fields=id&tenant_id=6178223d48944b6ba503c95dcdaa1089 HTTP/1.1" status: 200 len: 267 time: 0.0516748 Nov 15 17:58:49.194982 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-0c640490-57e9-4905-b943-a243170461c2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:49.196483 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-0c640490-57e9-4905-b943-a243170461c2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 984 time: 0.0513892 Nov 15 17:58:49.207322 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.v2.base [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Request body: {'port': {'security_groups': ['5aea9168-36ea-4859-8653-eac99ba3fb1f']}} {{(pid=108141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 17:58:49.278990 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.461488 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:49.492725 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for port, precommit_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.499489 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-59170129'] for port, after_update {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.512968 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:58:49.540941 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:49.541607 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.543060 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-20d2ad56-30b4-4524-b99b-da2314c65f4d req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "PUT /v2.0/ports/ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 942 time: 0.3401830 Nov 15 17:58:49.549858 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34282) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:58:49.554683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:58:49.556970 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2" -d '{"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:58:49.575201 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event updated for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=7']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:49.583639 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.584065 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.584407 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.584746 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.585079 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.585475 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.585810 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.586208 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.586555 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.586884 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.587207 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.587530 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55eb8190-490a-42aa-b74f-26693d7c6a3a tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.652016 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.664071 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:58:49.686969 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.700729 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:58:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea1b38fd-567b-45ca-93eb-3ba969964f0f x-openstack-request-id: req-ea1b38fd-567b-45ca-93eb-3ba969964f0f {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:58:49.701019 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:58:49.701275 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ea1b38fd-567b-45ca-93eb-3ba969964f0f {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:58:49.701681 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:58:49.801501 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.804108 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.805349 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "DELETE /v2.0/security-groups/03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58 HTTP/1.1" status: 204 len: 168 time: 0.2543733 Nov 15 17:58:49.808386 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34288) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:58:49.810145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-c0ef6577-7990-48fb-896c-04f6dc6724fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:49.811598 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-c0ef6577-7990-48fb-896c-04f6dc6724fb service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1098 time: 0.0730972 Nov 15 17:58:49.818124 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=03c8bc80-e3ca-4ce7-a6b1-4e06578ddc58,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:49.822549 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-2473be31-2c8c-4651-acef-ad63fc422031 None None] Provisioning complete for port ef009656-31c1-4948-9072-989fa7241e3b triggered by entity DHCP. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:58:49.822913 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-2473be31-2c8c-4651-acef-ad63fc422031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:49.825330 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.825651 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.825975 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.826312 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.826705 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.826971 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.827307 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.827629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.827984 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.828308 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.828647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.828959 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dae6310d-f2dc-4671-8bc1-bc1f8c518179 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:58:49.947125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-f763e203-55a6-434f-86b5-22a0f7d90975 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:49.949312 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-f763e203-55a6-434f-86b5-22a0f7d90975 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.1081698 Nov 15 17:58:50.031949 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-566277c0-6bd4-415a-ab1a-d04523172147 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 1001 time: 0.0590706 Nov 15 17:58:50.048819 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf3fcb0f-76b6-4350-a757-2b6db9d4fc25 req-31734761-c1e9-4e50-8210-2d662577b750 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:50.050311 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cf3fcb0f-76b6-4350-a757-2b6db9d4fc25 req-31734761-c1e9-4e50-8210-2d662577b750 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 943 time: 0.0831625 Nov 15 17:58:50.096653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-aba0d1f2-9f91-489d-a3ef-68bb0da11f54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:50.098193 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-aba0d1f2-9f91-489d-a3ef-68bb0da11f54 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0473514 Nov 15 17:58:50.112281 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-cf3fcb0f-76b6-4350-a757-2b6db9d4fc25 req-49f998e8-c4a4-40c5-9f27-71904f7624ae tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544307 Nov 15 17:58:50.115047 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Deleting port da0f30b9-3d29-4b01-bd2a-90d7af4d273d {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:58:50.115363 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.145743 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-e6539993-ea4d-4745-9144-921c13f2528f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:50.147257 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-e6539993-ea4d-4745-9144-921c13f2528f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408106 Nov 15 17:58:50.164758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 details requested by agent hyperv_hv-cinder-78836 with host hv-cinder-78836 {{(pid=108143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 17:58:50.191120 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.191446 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.203343 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Calling delete_port for da0f30b9-3d29-4b01-bd2a-90d7af4d273d owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:58:50.242670 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-142321c3-b084-441f-a9ab-9f6ded1cc9a2 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875306 Nov 15 17:58:50.261986 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:50.273731 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Returning: {'device': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'port_id': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'mac_address': 'fa:16:3e:14:56:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 437, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 17:58:50.316210 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.329956 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 {{(pid=108143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 17:58:50.333813 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-6cc378ac-cdaf-4905-b5b9-1d7f530023b2 req-27116798-7fa6-4a21-ab28-0aa0e1311605 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833738 Nov 15 17:58:50.352688 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:50.356995 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.391241 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.406879 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=7']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:50.415576 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event deleted for resources: {'Port': ['ID=da0f30b9-3d29-4b01-bd2a-90d7af4d273d,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:50.473033 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:50.473439 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Floating IP 750b6884-aae0-448b-ad09-8c96476d5166 disassociated (deleted). External IP: 172.27.0.166, port: ef009656-31c1-4948-9072-989fa7241e3b. Nov 15 17:58:50.622948 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:58:50.693139 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Router 584aa81d-01fd-4562-8c25-b74e291f924b has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:58:51.045914 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:58:51.050868 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:51.056410 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Sync routers for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:58:51.066997 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:58:51.067584 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:58:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:51.077148 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-c1fd61f4-19f7-43fd-bb68-8f1292e429b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "DELETE /v2.0/floatingips/750b6884-aae0-448b-ad09-8c96476d5166 HTTP/1.1" status: 204 len: 168 time: 1.2669685 Nov 15 17:58:51.192773 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:58:51.240413 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f833acc9-7761-4f0b-bf9a-6448ee0f56ef req-7509cc50-6177-4d2e-8447-6f1ae6a3279e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:51.242230 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f833acc9-7761-4f0b-bf9a-6448ee0f56ef req-7509cc50-6177-4d2e-8447-6f1ae6a3279e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 944 time: 0.0516307 Nov 15 17:58:51.317938 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-f833acc9-7761-4f0b-bf9a-6448ee0f56ef req-476eb0bb-13ff-4572-84d3-0ea83eb9e91c tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690773 Nov 15 17:58:51.401019 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:51.429950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Checking router: 584aa81d-01fd-4562-8c25-b74e291f924b for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:58:51.439276 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:58:51.440043 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:58:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:51.547222 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:58:51.703616 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:58:51.706181 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b" -d '{"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:58:51.741862 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:58:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e12c46eb-88df-40d7-8a54-e33725fd64f3 x-openstack-request-id: req-e12c46eb-88df-40d7-8a54-e33725fd64f3 {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:58:51.742149 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:58:51.742402 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e12c46eb-88df-40d7-8a54-e33725fd64f3 {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:58:51.742793 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:58:51.749181 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:51.779254 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3dfce81-e1ba-4047-bfc5-56fc5ef7572f None None] The sync data for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi is: [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:56:42Z', 'revision_number': 4, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b62383e4-d9b3-418e-88f9-01eec51d2fe7', 'name': '', 'network_id': 'c79add16-3f72-42fd-a9c3-e0a2bf5f312f', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'mac_address': 'fa:16:3e:40:c7:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:41Z', 'updated_at': '2021-11-15T17:56:47Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'subnets': [{'id': '775e7c93-5715-4404-bdb1-411ccedb6a65', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:58:51.809033 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-a276437d-bf4a-4b26-9062-c53753081cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:51.810538 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-a276437d-bf4a-4b26-9062-c53753081cbd service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=6178223d48944b6ba503c95dcdaa1089&device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 1098 time: 0.0448968 Nov 15 17:58:51.910983 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-8ec5ea00-80ff-44f5-86dd-d89016335688 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:51.912490 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-8ec5ea00-80ff-44f5-86dd-d89016335688 service neutron] 10.222.0.48 "GET /v2.0/networks?id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 200 len: 915 time: 0.0921860 Nov 15 17:58:51.955007 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-dbf5f8a1-d178-43d5-9fb8-8e6191ba9024 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 200 len: 217 time: 0.0335555 Nov 15 17:58:52.002044 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a88376e-d426-4403-b4c2-8d2369c5a1d2 None None] New status for floating IP 750b6884-aae0-448b-ad09-8c96476d5166: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:58:52.010467 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-fbbb7274-b85c-429b-b93d-a759c65135da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:52.012023 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-fbbb7274-b85c-429b-b93d-a759c65135da service neutron] 10.222.0.48 "GET /v2.0/subnets?id=775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 200 len: 853 time: 0.0491378 Nov 15 17:58:52.059820 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-a8319896-e179-4891-9778-23ce4c750efa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:52.061297 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-a8319896-e179-4891-9778-23ce4c750efa service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=c79add16-3f72-42fd-a9c3-e0a2bf5f312f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393212 Nov 15 17:58:52.152872 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-eca14d72-0d1c-4081-a004-c8cdfd47e641 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823436 Nov 15 17:58:52.183046 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 up at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 17:58:52.233176 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.provisioning_blocks [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Provisioning complete for port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 triggered by entity L2. {{(pid=108143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 17:58:52.233545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-684225'] for port, provisioning_complete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:52.245305 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-cdee6c9e-80d6-4a8a-9068-10e5caf9f06b req-f843ddbd-72fc-4af0-ae22-9f4d3376ba28 service neutron] 10.222.0.48 "GET /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843830 Nov 15 17:58:52.310431 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-670735'] for port, before_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:52.334565 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:58:52.336901 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cff30dbdc4e1fbef0aa1d504231fa1f8997266d1abe61e03f61ee664f28ece86" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6b3b430-c581-47f0-88db-a343e5caceeb" -d '{"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-plugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:58:52.354183 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:52.359613 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762238850223', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762238340536', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762238340554'] for port, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:52.385195 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:58:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad763049-08d7-4185-b5e9-b6918f6dc3a6 x-openstack-request-id: req-ad763049-08d7-4185-b5e9-b6918f6dc3a6 {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:58:52.385484 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-plugged", "status": "completed", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "code": 200}]} {{(pid=108143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:58:52.385732 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ad763049-08d7-4185-b5e9-b6918f6dc3a6 {{(pid=108143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:58:52.386111 dv-cinder-788366-7-iscsi neutron-server[108143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'code': 200} Nov 15 17:58:52.412712 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Pushing event updated for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=8']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:52.434661 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:53.837908 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bd078a-f1c3-4e3f-b987-b0afc9af0fde req-8a33cac9-d3ad-45de-a5c3-d677132ec1a8 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:53.839304 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-90bd078a-f1c3-4e3f-b987-b0afc9af0fde req-8a33cac9-d3ad-45de-a5c3-d677132ec1a8 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0651424 Nov 15 17:58:53.886365 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-90bd078a-f1c3-4e3f-b987-b0afc9af0fde req-15643553-0ed7-43c4-afc8-6016f87e19c9 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409062 Nov 15 17:58:55.013814 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68884920-33fa-44e1-9d37-754fc5609cb0 req-a50c38c3-c016-4a2f-9371-dc692ea2252d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:55.015329 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68884920-33fa-44e1-9d37-754fc5609cb0 req-a50c38c3-c016-4a2f-9371-dc692ea2252d tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0502050 Nov 15 17:58:55.063573 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-68884920-33fa-44e1-9d37-754fc5609cb0 req-2b0af3b9-435f-46b6-99ac-1af3602211b2 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/security-groups?id=5aea9168-36ea-4859-8653-eac99ba3fb1f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412009 Nov 15 17:58:55.496947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-847d198d-0de6-4957-8f0a-1dff2a47eb17 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:58:55.498417 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-847d198d-0de6-4957-8f0a-1dff2a47eb17 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.48 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 945 time: 0.0560443 Nov 15 17:58:55.593520 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Deleting port ef009656-31c1-4948-9072-989fa7241e3b {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:58:55.593855 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:55.682564 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] For port ef009656-31c1-4948-9072-989fa7241e3b, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=ef009656-31c1-4948-9072-989fa7241e3b,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:55.682916 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:55.697137 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Calling delete_port for ef009656-31c1-4948-9072-989fa7241e3b owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:58:55.844446 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:55.856494 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] get_ports_and_sgs() called for port_ids ['ef009656-31c1-4948-9072-989fa7241e3b'] {{(pid=108143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 17:58:55.872524 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Pushing event deleted for resources: {'Port': ['ID=ef009656-31c1-4948-9072-989fa7241e3b,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:55.914099 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] No DVR routers for this DVR port ef009656-31c1-4948-9072-989fa7241e3b on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:58:55.917057 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:55.920407 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-d2b0f9d0-1d98-44b7-82a0-b2a58bdcbfee req-cefec349-3df0-46cd-8f2c-783c80987988 tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.48 "DELETE /v2.0/ports/ef009656-31c1-4948-9072-989fa7241e3b HTTP/1.1" status: 204 len: 173 time: 0.4148712 Nov 15 17:58:55.920834 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'name': 'network-vif-deleted', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:58:55.923082 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e8e5f1d-7f3a-4756-a86f-6d02672911c6" -d '{"events": [{"server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "name": "network-vif-deleted", "tag": "ef009656-31c1-4948-9072-989fa7241e3b"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:58:56.022197 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:58:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40091611-678b-4e31-b4a9-45930d890845 x-openstack-request-id: req-40091611-678b-4e31-b4a9-45930d890845 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:58:56.023014 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b5dd46b-0851-4cb8-81a4-780300b72ce1", "name": "network-vif-deleted", "tag": "ef009656-31c1-4948-9072-989fa7241e3b", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:58:56.023014 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-40091611-678b-4e31-b4a9-45930d890845 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:58:56.023279 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b5dd46b-0851-4cb8-81a4-780300b72ce1', 'name': 'network-vif-deleted', 'tag': 'ef009656-31c1-4948-9072-989fa7241e3b', 'status': 'completed', 'code': 200} Nov 15 17:58:56.192064 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-2f7b607d-63b4-4644-985c-f0e29e217978 req-c55cdf0f-7ebf-422f-9605-fa49e37cd11f tempest-TestMinimumBasicScenario-1984546719 tempest-TestMinimumBasicScenario-1984546719-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b5dd46b-0851-4cb8-81a4-780300b72ce1 HTTP/1.1" status: 200 len: 210 time: 0.0339377 Nov 15 17:58:57.822630 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34382) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:58:58.176675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:58.434007 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Deleting port b62383e4-d9b3-418e-88f9-01eec51d2fe7 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:58:58.434243 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:58.515030 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] For port b62383e4-d9b3-418e-88f9-01eec51d2fe7, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b62383e4-d9b3-418e-88f9-01eec51d2fe7,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:58.515418 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:58.527764 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Calling delete_port for b62383e4-d9b3-418e-88f9-01eec51d2fe7 owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:58:58.723779 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:58.752743 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Pushing event deleted for resources: {'Port': ['ID=b62383e4-d9b3-418e-88f9-01eec51d2fe7,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:58.914578 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.155600 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Router 584aa81d-01fd-4562-8c25-b74e291f924b has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:58:59.276331 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:58:59.282609 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-43978f61-b907-4f2c-b36b-ddf390b1fe5b admin admin] 10.222.0.31 "PUT /v2.0/routers/584aa81d-01fd-4562-8c25-b74e291f924b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4578669 Nov 15 17:58:59.284173 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34384) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:58:59.287371 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Sync routers for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:58:59.301000 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:58:59.301602 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:58:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:59.385165 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.399897 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:58:59.485845 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.546756 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Deleting port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:58:59.547093 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.630340 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] For port a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:58:59.630714 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.646914 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Calling delete_port for a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:58:59.703833 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:58:58Z', 'revision_number': 5, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port': {'id': 'a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:c9:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:40Z', 'updated_at': '2021-11-15T17:56:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:59.728995 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Checking router: 584aa81d-01fd-4562-8c25-b74e291f924b for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:58:59.738170 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Routers {'584aa81d-01fd-4562-8c25-b74e291f924b'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:58:59.739035 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:58:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['584aa81d-01fd-4562-8c25-b74e291f924b'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:59.822989 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] Set router 584aa81d-01fd-4562-8c25-b74e291f924b gateway port host: None {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:58:59.825525 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:58:59.852382 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Pushing event deleted for resources: {'Port': ['ID=a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:58:59.876920 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:58:59Z', 'revision_number': 6, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:58:59.903100 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5332dfc6-8366-4dcf-81f7-d0571ce38934 None None] The sync data for ids ['584aa81d-01fd-4562-8c25-b74e291f924b'] in dv-cinder-788366-7-iscsi is: [{'id': '584aa81d-01fd-4562-8c25-b74e291f924b', 'name': 'tempest-TestMinimumBasicScenario-553874745-router', 'tenant_id': '6178223d48944b6ba503c95dcdaa1089', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:39Z', 'updated_at': '2021-11-15T17:58:59Z', 'revision_number': 6, 'project_id': '6178223d48944b6ba503c95dcdaa1089', 'gw_port_host': None}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:58:59.919209 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.008364 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.010768 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.061710 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.062704 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 584aa81d-01fd-4562-8c25-b74e291f924b {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:59:00.070864 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.072580 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0d660b31-a31b-4ed9-8921-4ecd09cf0aa2 admin admin] 10.222.0.31 "DELETE /v2.0/routers/584aa81d-01fd-4562-8c25-b74e291f924b HTTP/1.1" status: 204 len: 168 time: 0.7873838 Nov 15 17:59:00.075431 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34386) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:00.121353 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Deleting subnet 775e7c93-5715-4404-bdb1-411ccedb6a65 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:59:00.124731 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.158040 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.187839 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device ef009656-31c1-4948-9072-989fa7241e3b no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:00.212471 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: ef009656-31c1-4948-9072-989fa7241e3b {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:00.212813 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device ef009656-31c1-4948-9072-989fa7241e3b not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:00.246771 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.299720 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.326722 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=775e7c93-5715-4404-bdb1-411ccedb6a65,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:00.332535 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.335594 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-41a5563b-2c04-46c9-ad75-1beca71c6753 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/775e7c93-5715-4404-bdb1-411ccedb6a65 HTTP/1.1" status: 204 len: 168 time: 0.2591076 Nov 15 17:59:00.338778 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34388) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:00.341903 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7eb6299-24d6-45ad-862b-16fc1508b9f4 None None] Network c79add16-3f72-42fd-a9c3-e0a2bf5f312f requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:59:00.414393 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.470898 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Deleting port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:00.471235 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.532711 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] For port 08e74965-3d1d-4d27-9ac6-fac600ec00d1, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=08e74965-3d1d-4d27-9ac6-fac600ec00d1,segment=NetworkSegment(42b749ed-dfd6-4403-8018-6ac2558cada8),segment_id=42b749ed-dfd6-4403-8018-6ac2558cada8)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:00.533003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.544755 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Calling delete_port for 08e74965-3d1d-4d27-9ac6-fac600ec00d1 owned by network:dhcp {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:00.623097 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.645178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Pushing event deleted for resources: {'Port': ['ID=08e74965-3d1d-4d27-9ac6-fac600ec00d1,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:00.651813 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] No DVR routers for this DVR port 08e74965-3d1d-4d27-9ac6-fac600ec00d1 on host dv-cinder-788366-7-iscsi {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:00.700759 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e88e34a-db4e-4c08-86e5-495bcd51beae None None] DHCP port deletion for c79add16-3f72-42fd-a9c3-e0a2bf5f312f request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:59:00.723402 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:00.749560 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c79add16-3f72-42fd-a9c3-e0a2bf5f312f']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:00.758656 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42b749ed-dfd6-4403-8018-6ac2558cada8') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:00.758953 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42b749ed-dfd6-4403-8018-6ac2558cada8') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:00.809351 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7b28657c-bcc7-47ea-ad87-3ae37d0a9b21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.031172 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.045159 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.051194 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Releasing vlan 411 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:59:01.051569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:59:01.053300 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:59:01.107289 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.114990 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.118223 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] 10.222.0.31 "DELETE /v2.0/networks/c79add16-3f72-42fd-a9c3-e0a2bf5f312f HTTP/1.1" status: 204 len: 168 time: 0.7776983 Nov 15 17:59:01.121472 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34390) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:01.129488 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a526a7ad-0002-416c-be95-094a0a82b4e4 admin admin] Pushing event deleted for resources: {'Network': ['ID=c79add16-3f72-42fd-a9c3-e0a2bf5f312f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:01.473212 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:01.712898 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:01.733719 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:01.734068 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device a27c8d8d-7ca6-4b3b-ac45-4991851f9d9f not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:01.734551 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b62383e4-d9b3-418e-88f9-01eec51d2fe7 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:01.754620 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: b62383e4-d9b3-418e-88f9-01eec51d2fe7 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:01.754928 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b62383e4-d9b3-418e-88f9-01eec51d2fe7 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:01.755372 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 08e74965-3d1d-4d27-9ac6-fac600ec00d1 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:01.774307 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 08e74965-3d1d-4d27-9ac6-fac600ec00d1 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:01.774646 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 08e74965-3d1d-4d27-9ac6-fac600ec00d1 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:01.974548 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Deleting port dff0772e-eded-49f0-932d-f7b33ff8a3d6 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:01.974850 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:02.052774 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] For port dff0772e-eded-49f0-932d-f7b33ff8a3d6, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=dff0772e-eded-49f0-932d-f7b33ff8a3d6,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:02.053057 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:02.065376 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Calling delete_port for dff0772e-eded-49f0-932d-f7b33ff8a3d6 owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:02.260942 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:02.297567 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Pushing event deleted for resources: {'Port': ['ID=dff0772e-eded-49f0-932d-f7b33ff8a3d6,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:02.456740 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:02.688451 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Router 5c9ae027-a7b7-41f2-ab49-9c358b6610db has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:59:02.803674 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:59:02.809990 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-221a75d2-0878-4d34-bff8-4959d05b7b5b admin admin] 10.222.0.31 "PUT /v2.0/routers/5c9ae027-a7b7-41f2-ab49-9c358b6610db/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6873584 Nov 15 17:59:02.812033 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34392) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:02.813278 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Sync routers for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:59:02.824910 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:02.825522 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:58:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:02.915962 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:02.927584 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:03.017278 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.074680 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Deleting port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:03.074810 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.128123 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-dc5e5848-ee34-4bcf-bed2-435431f4f047 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.161250 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] For port 32f3317a-35cc-4d86-b95b-9deb35b0ca6d, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:03.161637 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.174185 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Calling delete_port for 32f3317a-35cc-4d86-b95b-9deb35b0ca6d owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:03.190855 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17'}], 'enable_snat': True}, 'gw_port_id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:59:02Z', 'revision_number': 5, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port': {'id': '32f3317a-35cc-4d86-b95b-9deb35b0ca6d', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:25:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.17', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:56:44Z', 'updated_at': '2021-11-15T17:56:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:03.220473 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Checking router: 5c9ae027-a7b7-41f2-ab49-9c358b6610db for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:59:03.229978 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Routers {'5c9ae027-a7b7-41f2-ab49-9c358b6610db'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:03.230572 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:03.319785 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] Set router 5c9ae027-a7b7-41f2-ab49-9c358b6610db gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:03.343107 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.370316 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Pushing event deleted for resources: {'Port': ['ID=32f3317a-35cc-4d86-b95b-9deb35b0ca6d,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:03.370947 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:59:03Z', 'revision_number': 6, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:03.401696 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fab5a91d-e6a8-47c3-847b-61136dbc21ae None None] The sync data for ids ['5c9ae027-a7b7-41f2-ab49-9c358b6610db'] in dv-cinder-788366-7-iscsi is: [{'id': '5c9ae027-a7b7-41f2-ab49-9c358b6610db', 'name': 'tempest-TestMinimumBasicScenario-852369918-router', 'tenant_id': 'c816ff326bb64f309cd66657d7f76bb1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:56:43Z', 'updated_at': '2021-11-15T17:59:03Z', 'revision_number': 6, 'project_id': 'c816ff326bb64f309cd66657d7f76bb1', 'gw_port_host': None}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:59:03.429863 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.525805 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.527949 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.581869 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.582421 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5c9ae027-a7b7-41f2-ab49-9c358b6610db {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:59:03.587182 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.588400 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-89a076da-081f-4b7f-a417-6612799df2fb admin admin] 10.222.0.31 "DELETE /v2.0/routers/5c9ae027-a7b7-41f2-ab49-9c358b6610db HTTP/1.1" status: 204 len: 168 time: 0.7753081 Nov 15 17:59:03.590982 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34396) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:03.636958 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Deleting subnet 13d7214d-dca8-4983-8a11-153b45bde2ef {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:59:03.640526 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.675420 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.759413 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.817601 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.838996 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-283113e1-b6c2-4d97-ba51-34f0c8e3f0eb None None] Network 3e6e03e1-f7bd-45ef-801e-102163545fa4 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:59:03.848579 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.854469 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/13d7214d-dca8-4983-8a11-153b45bde2ef HTTP/1.1" status: 204 len: 168 time: 0.2599368 Nov 15 17:59:03.854702 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34398) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:03.855428 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f108da7-6c20-4ef7-916b-2b13297798d4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=13d7214d-dca8-4983-8a11-153b45bde2ef,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:03.896991 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dff0772e-eded-49f0-932d-f7b33ff8a3d6 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:03.925143 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: dff0772e-eded-49f0-932d-f7b33ff8a3d6 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:03.925536 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device dff0772e-eded-49f0-932d-f7b33ff8a3d6 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:03.929890 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:03.980506 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Deleting port 22e5dde0-ff30-45e4-8c36-5713ab3df45d {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:03.980832 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.043334 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] For port 22e5dde0-ff30-45e4-8c36-5713ab3df45d, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=22e5dde0-ff30-45e4-8c36-5713ab3df45d,segment=NetworkSegment(f0ca50e6-67a1-4c41-a0b4-6a2751838480),segment_id=f0ca50e6-67a1-4c41-a0b4-6a2751838480)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:04.043742 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.055597 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Calling delete_port for 22e5dde0-ff30-45e4-8c36-5713ab3df45d owned by network:dhcp {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:04.138199 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.162029 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=22e5dde0-ff30-45e4-8c36-5713ab3df45d,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:04.165521 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] No DVR routers for this DVR port 22e5dde0-ff30-45e4-8c36-5713ab3df45d on host dv-cinder-788366-7-iscsi {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:04.224464 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7742f51-cbd3-4a8c-9c8f-53d162cb5538 None None] DHCP port deletion for 3e6e03e1-f7bd-45ef-801e-102163545fa4 request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:59:04.240577 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.261762 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3e6e03e1-f7bd-45ef-801e-102163545fa4']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:04.270740 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f0ca50e6-67a1-4c41-a0b4-6a2751838480') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:04.271023 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f0ca50e6-67a1-4c41-a0b4-6a2751838480') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:04.280222 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.293040 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.299300 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Releasing vlan 443 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:59:04.299751 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:59:04.301714 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:59:04.359003 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.364694 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.367857 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] 10.222.0.31 "DELETE /v2.0/networks/3e6e03e1-f7bd-45ef-801e-102163545fa4 HTTP/1.1" status: 204 len: 168 time: 0.5120986 Nov 15 17:59:04.379166 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0a49f7-1f12-423f-8b8d-0aa93b53f6e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=3e6e03e1-f7bd-45ef-801e-102163545fa4,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:04.506823 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.538711 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34402) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:04.581464 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4c9561f6-237b-400b-b29f-5c703b1a1175 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6178223d48944b6ba503c95dcdaa1089&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0415297 Nov 15 17:59:04.583949 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34404) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:04.631416 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.652193 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.698663 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.701343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:04.702481 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5aea9168-36ea-4859-8653-eac99ba3fb1f HTTP/1.1" status: 204 len: 168 time: 0.1176562 Nov 15 17:59:04.710091 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441ec297-3b1c-44c0-8fe4-6a1a2ad63aea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5aea9168-36ea-4859-8653-eac99ba3fb1f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:05.058097 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34410) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:05.098096 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-1f362b9f-f1fc-41a5-a475-94d8e45e804d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c816ff326bb64f309cd66657d7f76bb1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0388248 Nov 15 17:59:05.101981 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34412) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:05.156993 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:05.178641 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:05.230459 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:05.233237 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:05.234355 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/bb11f364-b0de-48ad-b99c-d6119d47f6eb HTTP/1.1" status: 204 len: 168 time: 0.1315360 Nov 15 17:59:05.242083 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0658f9e9-7fc7-439b-8619-23ccff68897a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb11f364-b0de-48ad-b99c-d6119d47f6eb,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:05.615027 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:05.687870 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 32f3317a-35cc-4d86-b95b-9deb35b0ca6d no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:05.710642 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 32f3317a-35cc-4d86-b95b-9deb35b0ca6d {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:05.710996 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 32f3317a-35cc-4d86-b95b-9deb35b0ca6d not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:05.711397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 22e5dde0-ff30-45e4-8c36-5713ab3df45d no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:05.729872 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 22e5dde0-ff30-45e4-8c36-5713ab3df45d {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:05.730184 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 22e5dde0-ff30-45e4-8c36-5713ab3df45d not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:06.668601 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:13.062409 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:59:22.462186 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:26.404463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34424) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:26.801164 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port 01f658e3-fcdd-4a44-bce9-54b31f55f3a0 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:26.801454 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:26.883603 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:26.884072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:26.896858 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for 01f658e3-fcdd-4a44-bce9-54b31f55f3a0 owned by network:floatingip {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:27.072636 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:27.106306 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=01f658e3-fcdd-4a44-bce9-54b31f55f3a0,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:27.162361 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:27.162733 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 236d8684-fd8f-4578-a1f2-0d356f6d00fb disassociated (deleted). External IP: 172.27.0.60, port: d86b2d7c-54b7-4f20-ae69-6c89d42fea89. Nov 15 17:59:27.381657 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:59:27.497072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:59:27.501875 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:27.508528 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:59:27.519103 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:27.519834 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:27.531801 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b420c3e8-1a77-4c94-b388-8061d004fefe tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "DELETE /v2.0/floatingips/236d8684-fd8f-4578-a1f2-0d356f6d00fb HTTP/1.1" status: 204 len: 168 time: 1.1235988 Nov 15 17:59:27.531801 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:59:27.532279 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86" -d '{"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:59:27.571822 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:59:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b5d57b9-4cf8-45bf-9c1c-6c546ea094bd x-openstack-request-id: req-8b5d57b9-4cf8-45bf-9c1c-6c546ea094bd {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:59:27.572112 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:59:27.572363 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-8b5d57b9-4cf8-45bf-9c1c-6c546ea094bd {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:59:27.572761 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'status': 'completed', 'code': 200} Nov 15 17:59:27.631332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:27.638750 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-cd170585-2a5d-4bff-a4f6-eae032605927 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:27.640470 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-cd170585-2a5d-4bff-a4f6-eae032605927 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 1098 time: 0.0426137 Nov 15 17:59:27.764595 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-75617b45-3061-41ef-9983-b2d460d5d0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:27.765500 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518b99c7-e4d2-4874-8074-de366e2ac7a7 req-566fcfae-76ed-458c-851b-e3fdc63bb3ed tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:27.766070 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-75617b45-3061-41ef-9983-b2d460d5d0e8 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.1056292 Nov 15 17:59:27.767776 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-518b99c7-e4d2-4874-8074-de366e2ac7a7 req-566fcfae-76ed-458c-851b-e3fdc63bb3ed tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0537510 Nov 15 17:59:27.810734 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-71999fe7-9730-46bf-a29d-d84dea49a061 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 200 len: 217 time: 0.0362146 Nov 15 17:59:27.824280 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-518b99c7-e4d2-4874-8074-de366e2ac7a7 req-91f8e6e5-e19d-4e69-877a-45325c702c0d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501044 Nov 15 17:59:27.862910 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-ff1c90e6-31f6-4b2e-acf7-44cf6d10517f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:27.864854 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-ff1c90e6-31f6-4b2e-acf7-44cf6d10517f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0463996 Nov 15 17:59:27.895230 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:27.915050 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-5dc9c563-4d27-451f-a272-06c6547bd18f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:27.916550 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-5dc9c563-4d27-451f-a272-06c6547bd18f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433149 Nov 15 17:59:27.920858 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:59:27.930150 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:27.930747 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:28.010841 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-52c27cb0-4535-4c8b-8de1-08b3ea4f263d service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848289 Nov 15 17:59:28.035730 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:28.106102 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8869e9da-35d6-4ce2-b999-e5b3d5dd3c86 req-31a7e90b-b715-43cf-b4f3-37d0d19e1fc7 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871859 Nov 15 17:59:28.270643 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:28.296246 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29c0a258-dc9d-4d28-9cb3-40cd5a1a6392 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_floatingips': [{'id': '37d45a79-70e4-4439-857b-472e6d802cb0', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'floating_ip_address': '172.27.0.133', 'floating_network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'router_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'port_id': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'mac_address': 'fa:16:3e:46:6e:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T17:55:53Z', 'updated_at': '2021-11-15T17:55:56Z', 'revision_number': 1, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:59:28.515979 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c029caa-ba1a-4e42-87ea-fe424b6d0e8a None None] New status for floating IP 236d8684-fd8f-4578-a1f2-0d356f6d00fb: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:59:28.958442 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e905f9-fb99-410b-a212-ebae5c691977 req-cdfb8f39-3b3a-4a54-ad2b-c3d9ddc90a87 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:28.959947 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74e905f9-fb99-410b-a212-ebae5c691977 req-cdfb8f39-3b3a-4a54-ad2b-c3d9ddc90a87 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0555139 Nov 15 17:59:29.013801 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-74e905f9-fb99-410b-a212-ebae5c691977 req-a21c47d3-427c-47ef-8960-825cc1f7807f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448356 Nov 15 17:59:29.297056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-c338237a-51e3-4a1d-a472-f89333e686fd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:29.298505 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-c338237a-51e3-4a1d-a472-f89333e686fd tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 945 time: 0.0578926 Nov 15 17:59:29.396815 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:29.397125 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:29.496380 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] For port d86b2d7c-54b7-4f20-ae69-6c89d42fea89, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:29.496715 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:29.509610 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for d86b2d7c-54b7-4f20-ae69-6c89d42fea89 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:29.644994 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:29.680384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=d86b2d7c-54b7-4f20-ae69-6c89d42fea89,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:29.718568 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] No DVR routers for this DVR port d86b2d7c-54b7-4f20-ae69-6c89d42fea89 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:29.721434 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:29.724812 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-7d347b29-5ca8-4ae3-8c1b-89bfb8cd8f7f req-278cc186-f20e-4272-b985-198b5dee67a0 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "DELETE /v2.0/ports/d86b2d7c-54b7-4f20-ae69-6c89d42fea89 HTTP/1.1" status: 204 len: 173 time: 0.4193883 Nov 15 17:59:29.725264 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'name': 'network-vif-deleted', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:59:29.727555 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79d48941-543a-4956-9f65-f6d1ac50445e" -d '{"events": [{"server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "name": "network-vif-deleted", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:59:29.774294 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:59:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8565fea7-71ea-430e-ad7a-5eb3ee559d7a x-openstack-request-id: req-8565fea7-71ea-430e-ad7a-5eb3ee559d7a {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:59:29.774594 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c", "name": "network-vif-deleted", "tag": "d86b2d7c-54b7-4f20-ae69-6c89d42fea89", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:59:29.774848 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-8565fea7-71ea-430e-ad7a-5eb3ee559d7a {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:59:29.775246 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c', 'name': 'network-vif-deleted', 'tag': 'd86b2d7c-54b7-4f20-ae69-6c89d42fea89', 'status': 'completed', 'code': 200} Nov 15 17:59:30.140434 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-8f7799be-5a62-4b7e-8812-70dd4c3408ed req-7efc0001-b3c0-4594-a8db-703755fe86e4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=b3d7c9bb-c64f-42e4-94d8-4010ebd94f5c HTTP/1.1" status: 200 len: 210 time: 0.0269363 Nov 15 17:59:30.811287 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-47f3d551-2a3a-4b35-bf93-e0ce9580b50a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:32.310521 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device d86b2d7c-54b7-4f20-ae69-6c89d42fea89 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:32.345319 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: d86b2d7c-54b7-4f20-ae69-6c89d42fea89 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:32.345656 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device d86b2d7c-54b7-4f20-ae69-6c89d42fea89 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:33.130836 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4f0944f2-a509-4a2e-bc80-d3d6964217b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.457255 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34454) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:33.620216 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port ee6c9aed-267c-49b1-aa83-71b8c8a621d6 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:33.620531 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.699824 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.700063 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.712130 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for ee6c9aed-267c-49b1-aa83-71b8c8a621d6 owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:33.872964 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.897690 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=ee6c9aed-267c-49b1-aa83-71b8c8a621d6,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:33.956550 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:33.956848 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.db.l3_db [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Floating IP 37d45a79-70e4-4439-857b-472e6d802cb0 disassociated (deleted). External IP: 172.27.0.133, port: f5758317-a1ce-4645-bc74-a6fda94fcfb1. Nov 15 17:59:34.169981 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:59:34.282610 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:59:34.287477 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:34.292197 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:59:34.301805 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:34.302411 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:34.314565 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-471c9351-b161-4523-bc5a-b135a56342a8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "DELETE /v2.0/floatingips/37d45a79-70e4-4439-857b-472e6d802cb0 HTTP/1.1" status: 204 len: 168 time: 0.8561163 Nov 15 17:59:34.315186 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1'}] {{(pid=108141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:59:34.317572 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d4fba4fb8e49e65e867b57929affa05cc5476b1297d7fb0ceb3ffd468d622480" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b0a0777-1a79-4f11-aa23-181e873baacd" -d '{"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1"}]}' {{(pid=108141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:59:34.355772 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 17:59:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d5d9ee5-f070-4b93-b50b-a4572e2dd84b x-openstack-request-id: req-9d5d9ee5-f070-4b93-b50b-a4572e2dd84b {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:59:34.356110 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1", "status": "completed", "code": 200}]} {{(pid=108141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:59:34.356289 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9d5d9ee5-f070-4b93-b50b-a4572e2dd84b {{(pid=108141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:59:34.356849 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'status': 'completed', 'code': 200} Nov 15 17:59:34.436625 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-36a7c4ea-9b15-4bb0-b5bd-522f8ab74755 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:34.438874 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-36a7c4ea-9b15-4bb0-b5bd-522f8ab74755 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 1099 time: 0.0501306 Nov 15 17:59:34.559310 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:34.561697 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-4aee246f-2a1d-406e-aae8-b64c21dbdea1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:34.563333 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-4aee246f-2a1d-406e-aae8-b64c21dbdea1 service neutron] 10.222.0.48 "GET /v2.0/networks?id=225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 200 len: 913 time: 0.1029494 Nov 15 17:59:34.568096 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b596e8d-e556-49f1-8687-46213b82ac58 req-5a10885d-0449-46e1-ba38-a5a6fe624e1d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:34.569599 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0b596e8d-e556-49f1-8687-46213b82ac58 req-5a10885d-0449-46e1-ba38-a5a6fe624e1d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.0499878 Nov 15 17:59:34.583947 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:34.610268 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-ead9cfe3-76fa-49b2-a9b6-6b34426d7ebb service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 200 len: 217 time: 0.0387650 Nov 15 17:59:34.622392 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0b596e8d-e556-49f1-8687-46213b82ac58 req-3e23cb9b-0719-400b-950e-9c719609d98f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457268 Nov 15 17:59:34.663048 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-d266b5c4-8cac-42d2-bef9-de80f2945516 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:34.663948 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-d266b5c4-8cac-42d2-bef9-de80f2945516 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 200 len: 851 time: 0.0453439 Nov 15 17:59:34.710262 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-46c70264-93d5-4e58-bbb7-12fde15cd271 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:34.711740 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-46c70264-93d5-4e58-bbb7-12fde15cd271 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=225bbc0e-9530-4b54-be05-d3092f2f1bf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393422 Nov 15 17:59:34.756545 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:34.786332 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:59:34.795278 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:34.795911 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:34.804337 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-c8b6ffe6-0e81-4958-bbe6-d5a14ebb4498 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837104 Nov 15 17:59:34.893133 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-0b0a0777-1a79-4f11-aa23-181e873baacd req-7678363e-7b12-4e7e-bae7-7c96e0fffbc4 service neutron] 10.222.0.48 "GET /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807426 Nov 15 17:59:34.898352 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:35.107903 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:35.134051 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc886bc-7bb4-4969-b1e3-662b0df8f6a9 None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:38Z', 'revision_number': 4, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': 'b34f97c1-f783-4899-80af-c491a59b2552', 'name': '', 'network_id': '225bbc0e-9530-4b54-be05-d3092f2f1bf3', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'mac_address': 'fa:16:3e:2a:50:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_interface', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:37Z', 'updated_at': '2021-11-15T17:52:43Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'subnets': [{'id': '4800e8bb-9314-46c0-b919-995a65894f5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:59:35.338859 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42520ca6-b538-47d9-a68c-90633154b355 None None] New status for floating IP 37d45a79-70e4-4439-857b-472e6d802cb0: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 17:59:35.626924 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:35.750634 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5963484-871a-464e-89ca-2f0c6e8bf227 req-74686940-58da-4803-9d40-b924dfd0f958 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:35.752141 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5963484-871a-464e-89ca-2f0c6e8bf227 req-74686940-58da-4803-9d40-b924dfd0f958 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.0543654 Nov 15 17:59:35.801307 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-e5963484-871a-464e-89ca-2f0c6e8bf227 req-994f8e72-9333-4c89-8f38-b52cc2767df4 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/security-groups?id=d1957e86-4d23-410d-832b-14bd8f646ece&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431945 Nov 15 17:59:36.020302 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-aac007ff-e02a-45e5-8963-48ed2f613d2d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 17:59:36.021652 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-aac007ff-e02a-45e5-8963-48ed2f613d2d tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 946 time: 0.0613949 Nov 15 17:59:36.114902 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port f5758317-a1ce-4645-bc74-a6fda94fcfb1 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:36.115247 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:36.209720 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] For port f5758317-a1ce-4645-bc74-a6fda94fcfb1, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=f5758317-a1ce-4645-bc74-a6fda94fcfb1,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:36.210084 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:36.223116 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for f5758317-a1ce-4645-bc74-a6fda94fcfb1 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:36.355724 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:36.387140 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=f5758317-a1ce-4645-bc74-a6fda94fcfb1,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:36.433361 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] No DVR routers for this DVR port f5758317-a1ce-4645-bc74-a6fda94fcfb1 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:36.436139 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:36.439546 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-8a7e9bc6-b416-4961-ab7c-88848ef3a2ac req-a23fb543-3882-4846-952d-adf957a1481f tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.48 "DELETE /v2.0/ports/f5758317-a1ce-4645-bc74-a6fda94fcfb1 HTTP/1.1" status: 204 len: 173 time: 0.4109726 Nov 15 17:59:36.440013 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'name': 'network-vif-deleted', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 17:59:36.442250 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5bc62be-cbc5-4173-8244-67580c10c3a5" -d '{"events": [{"server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "name": "network-vif-deleted", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 17:59:36.480464 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 17:59:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fe9b431-331e-4284-8854-8f67ede29772 x-openstack-request-id: req-1fe9b431-331e-4284-8854-8f67ede29772 {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 17:59:36.480816 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d838f62-9b12-49b9-b003-35dcdd735c0f", "name": "network-vif-deleted", "tag": "f5758317-a1ce-4645-bc74-a6fda94fcfb1", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 17:59:36.481072 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1fe9b431-331e-4284-8854-8f67ede29772 {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 17:59:36.481602 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d838f62-9b12-49b9-b003-35dcdd735c0f', 'name': 'network-vif-deleted', 'tag': 'f5758317-a1ce-4645-bc74-a6fda94fcfb1', 'status': 'completed', 'code': 200} Nov 15 17:59:36.663930 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:36.914122 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-0f813841-db96-4a3d-b306-34d6ca43f680 req-acceb763-6efd-4bd5-9cb0-aba50a975cee tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d838f62-9b12-49b9-b003-35dcdd735c0f HTTP/1.1" status: 200 len: 210 time: 0.0260456 Nov 15 17:59:37.982078 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34470) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:38.103357 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Deleting port 2c7cfb51-8d6d-4ea0-afef-4776c8aa32df {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:38.103663 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.187844 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.188114 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.200008 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Calling delete_port for 2c7cfb51-8d6d-4ea0-afef-4776c8aa32df owned by network:floatingip {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:38.336414 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.363671 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'Port': ['ID=2c7cfb51-8d6d-4ea0-afef-4776c8aa32df,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:38.424132 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for floatingip, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.426817 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:38.427997 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6ee34d73-5120-4a3c-a284-f285d0d2c7c8 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "DELETE /v2.0/floatingips/9555c4a5-a365-45f2-8502-dc3118e496a2 HTTP/1.1" status: 204 len: 168 time: 0.4448605 Nov 15 17:59:39.643349 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34482) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:39.706624 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:39.735538 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:39.799073 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:39.801783 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:39.802933 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] 10.222.0.31 "DELETE /v2.0/security-groups/d1957e86-4d23-410d-832b-14bd8f646ece HTTP/1.1" status: 204 len: 168 time: 0.1585844 Nov 15 17:59:39.812198 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1299bb-ebca-457d-8a4d-7c87ee42b181 tempest-TestVolumeBootPattern-689004361 tempest-TestVolumeBootPattern-689004361-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1957e86-4d23-410d-832b-14bd8f646ece,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:39.854793 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34486) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:40.341638 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device f5758317-a1ce-4645-bc74-a6fda94fcfb1 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:40.362378 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: f5758317-a1ce-4645-bc74-a6fda94fcfb1 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:40.362695 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device f5758317-a1ce-4645-bc74-a6fda94fcfb1 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:40.570444 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:40.823329 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Deleting port b34f97c1-f783-4899-80af-c491a59b2552 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:40.824092 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:40.907344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] For port b34f97c1-f783-4899-80af-c491a59b2552, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b34f97c1-f783-4899-80af-c491a59b2552,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:40.907787 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:40.921853 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Calling delete_port for b34f97c1-f783-4899-80af-c491a59b2552 owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:41.104785 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.131065 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Pushing event deleted for resources: {'Port': ['ID=b34f97c1-f783-4899-80af-c491a59b2552,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:41.291413 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.503345 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:59:41.616010 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:59:41.623821 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-56ee05f3-8799-4c53-b953-bfc766bc7d1d admin admin] 10.222.0.31 "PUT /v2.0/routers/e781591d-919c-4b7b-9349-8d2ed2dc1fd6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7652073 Nov 15 17:59:41.624225 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34490) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:41.625000 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Sync routers for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:59:41.634984 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:41.635582 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:41.729673 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.742553 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:41.831300 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.885458 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Deleting port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:41.885783 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.918936 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48'}], 'enable_snat': True}, 'gw_port_id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:59:41Z', 'revision_number': 5, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port': {'id': 'cd5d17e1-ccf5-45e3-908e-2e9ac9337d06', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:c0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:52:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:41.945731 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Checking router: e781591d-919c-4b7b-9349-8d2ed2dc1fd6 for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:59:41.954546 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Routers {'e781591d-919c-4b7b-9349-8d2ed2dc1fd6'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:41.955153 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:41.965802 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] For port cd5d17e1-ccf5-45e3-908e-2e9ac9337d06, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:41.966159 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:41.977970 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Calling delete_port for cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:42.042441 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] Set router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 gateway port host: None {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:42.091773 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:59:41Z', 'revision_number': 6, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:42.121192 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2663f9-92c6-4007-88fd-a2257b28ec0a None None] The sync data for ids ['e781591d-919c-4b7b-9349-8d2ed2dc1fd6'] in dv-cinder-788366-7-iscsi is: [{'id': 'e781591d-919c-4b7b-9349-8d2ed2dc1fd6', 'name': 'tempest-TestVolumeBootPattern-1780574719-router', 'tenant_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:35Z', 'updated_at': '2021-11-15T17:59:41Z', 'revision_number': 6, 'project_id': '02ec9c6dcc7d48c5b52b4ee146d42ec8', 'gw_port_host': None}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:59:42.146421 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.173167 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Pushing event deleted for resources: {'Port': ['ID=cd5d17e1-ccf5-45e3-908e-2e9ac9337d06,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:42.232207 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.320265 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.322549 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.373143 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.373589 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e781591d-919c-4b7b-9349-8d2ed2dc1fd6 {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:59:42.378127 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.379231 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-89ae650a-e494-418d-9a50-91385b76b508 admin admin] 10.222.0.31 "DELETE /v2.0/routers/e781591d-919c-4b7b-9349-8d2ed2dc1fd6 HTTP/1.1" status: 204 len: 168 time: 0.7540064 Nov 15 17:59:42.381744 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34492) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:42.425280 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Deleting subnet 4800e8bb-9314-46c0-b919-995a65894f5c {{(pid=108141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:59:42.428330 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.462622 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59181150'] for subnet, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.545954 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.597865 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59170183', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-59344323'] for subnet, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.626041 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4800e8bb-9314-46c0-b919-995a65894f5c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:42.627973 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for subnet, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.631773 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-d7f3733c-cac3-445f-be0f-7519194c87e5 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/4800e8bb-9314-46c0-b919-995a65894f5c HTTP/1.1" status: 204 len: 168 time: 0.2484605 Nov 15 17:59:42.632987 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27bac04f-a98b-4d42-bcdf-805aac1cb33e None None] Network 225bbc0e-9530-4b54-be05-d3092f2f1bf3 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:59:42.633935 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34494) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:42.705655 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.757510 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Deleting port 5bfc573a-0464-414f-a3f0-c3655d1aacfe {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:42.757838 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.822240 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] For port 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5bfc573a-0464-414f-a3f0-c3655d1aacfe,segment=NetworkSegment(47d0b0f5-1317-4399-8742-1fd52fe341fc),segment_id=47d0b0f5-1317-4399-8742-1fd52fe341fc)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:42.822520 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.846306 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Calling delete_port for 5bfc573a-0464-414f-a3f0-c3655d1aacfe owned by network:dhcp {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:42.907359 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] DHCP port deletion for 225bbc0e-9530-4b54-be05-d3092f2f1bf3 request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:59:42.932010 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.956307 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Deleting port 5bfc573a-0464-414f-a3f0-c3655d1aacfe {{(pid=108143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:42.956816 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:42.957666 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=5bfc573a-0464-414f-a3f0-c3655d1aacfe,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:42.961110 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] No DVR routers for this DVR port 5bfc573a-0464-414f-a3f0-c3655d1aacfe on host dv-cinder-788366-7-iscsi {{(pid=108141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:43.029643 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] For port 5bfc573a-0464-414f-a3f0-c3655d1aacfe, host dv-cinder-788366-7-iscsi, got binding levels [] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:43.030057 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.037048 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.043054 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Calling delete_port for 5bfc573a-0464-414f-a3f0-c3655d1aacfe owned by network:dhcp {{(pid=108143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:43.045782 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.ipam_backend_mixin [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Port 5bfc573a-0464-414f-a3f0-c3655d1aacfe was not found and therefore no delete operation was performed {{(pid=108143) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 15 17:59:43.047181 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527'] for port, after_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.057366 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['225bbc0e-9530-4b54-be05-d3092f2f1bf3']}} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:43.066534 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '47d0b0f5-1317-4399-8742-1fd52fe341fc') {'for_net_delete': True} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:43.066833 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.services.segments.db [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '47d0b0f5-1317-4399-8742-1fd52fe341fc') {} {{(pid=108141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:43.069680 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Pushing event deleted for resources: {'Port': ['ID=5bfc573a-0464-414f-a3f0-c3655d1aacfe,revision_number=None']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:43.077284 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59181159'] for segment, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.079436 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.080144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.080144 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.080439 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.080765 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.081086 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.081403 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.081847 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.082170 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.082485 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.082802 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.083113 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 17:59:43.085872 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff528aea-246c-4fe7-ac33-f69d0f5cb03f None None] No DVR routers for this DVR port 5bfc573a-0464-414f-a3f0-c3655d1aacfe on host dv-cinder-788366-7-iscsi {{(pid=108143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:43.098078 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.105490 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Releasing vlan 430 on physical network physnet1 to pool {{(pid=108141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:59:43.106304 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59170109'] for segment, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: Traceback (most recent call last): Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: timer() Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: cb(*args, **kw) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: return func(*args, **kwargs) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: self._notify() Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: self.callback(batched_events) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: event.method(event) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: return f(self, *a, **k) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._get(url).json() Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: return self.request(url, 'GET', **kwargs) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:59:43.108266 dv-cinder-788366-7-iscsi neutron-server[108141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:59:43.166260 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.172214 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.175447 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] 10.222.0.31 "DELETE /v2.0/networks/225bbc0e-9530-4b54-be05-d3092f2f1bf3 HTTP/1.1" status: 204 len: 168 time: 0.5406044 Nov 15 17:59:43.178487 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34496) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:43.186859 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4c33b2-0ade-4435-b2cc-c66a68eef6b0 admin admin] Pushing event deleted for resources: {'Network': ['ID=225bbc0e-9530-4b54-be05-d3092f2f1bf3,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:43.520095 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:43.717245 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5bfc573a-0464-414f-a3f0-c3655d1aacfe no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:43.739797 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 5bfc573a-0464-414f-a3f0-c3655d1aacfe {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:43.740088 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5bfc573a-0464-414f-a3f0-c3655d1aacfe not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:43.740542 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:43.760675 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:43.760973 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device cd5d17e1-ccf5-45e3-908e-2e9ac9337d06 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:43.761422 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b34f97c1-f783-4899-80af-c491a59b2552 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:43.781563 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: b34f97c1-f783-4899-80af-c491a59b2552 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:43.781818 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b34f97c1-f783-4899-80af-c491a59b2552 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:44.022705 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Deleting port 33240b16-e01c-400d-9083-3e4dde7e2ccd {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:44.023009 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:44.104919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] For port 33240b16-e01c-400d-9083-3e4dde7e2ccd, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=33240b16-e01c-400d-9083-3e4dde7e2ccd,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:44.105173 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:44.121788 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Calling delete_port for 33240b16-e01c-400d-9083-3e4dde7e2ccd owned by network:router_interface {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:44.316686 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:44.340648 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Pushing event deleted for resources: {'Port': ['ID=33240b16-e01c-400d-9083-3e4dde7e2ccd,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:44.502095 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:44.743348 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Router 3aa8b869-37d4-425e-b171-c047e6dc9e96 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 17:59:44.855477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 17:59:44.861518 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-f1f6c29d-a39d-48b5-ae27-2efac8b9db2b admin admin] 10.222.0.31 "PUT /v2.0/routers/3aa8b869-37d4-425e-b171-c047e6dc9e96/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6813827 Nov 15 17:59:44.863623 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34498) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:44.867516 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Sync routers for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 17:59:44.877642 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:44.878218 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:44.967724 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks [] for router, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:44.980053 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:45.067717 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.124025 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Deleting port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:45.124812 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.156065 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:59:44Z', 'revision_number': 5, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port': {'id': '9d95240a-ccfa-4ed4-9a44-c87e35b3805e', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:d0:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 509, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:52:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:45.186354 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Checking router: 3aa8b869-37d4-425e-b171-c047e6dc9e96 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 17:59:45.195133 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Routers {'3aa8b869-37d4-425e-b171-c047e6dc9e96'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 17:59:45.195738 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T17:59:33Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['3aa8b869-37d4-425e-b171-c047e6dc9e96'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:45.206194 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] For port 9d95240a-ccfa-4ed4-9a44-c87e35b3805e, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:45.206576 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.218066 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Calling delete_port for 9d95240a-ccfa-4ed4-9a44-c87e35b3805e owned by network:router_gateway {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:45.285644 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] Set router 3aa8b869-37d4-425e-b171-c047e6dc9e96 gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 17:59:45.336349 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:59:45Z', 'revision_number': 6, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:45.365890 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc147db-78f9-4f3f-ae7b-bddfd880fe40 None None] The sync data for ids ['3aa8b869-37d4-425e-b171-c047e6dc9e96'] in dv-cinder-788366-7-iscsi is: [{'id': '3aa8b869-37d4-425e-b171-c047e6dc9e96', 'name': 'tempest-TestVolumeBootPattern-680617592-router', 'tenant_id': '103cb3e2cd054174b3c5891117ab586a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:52:41Z', 'updated_at': '2021-11-15T17:59:45Z', 'revision_number': 6, 'project_id': '103cb3e2cd054174b3c5891117ab586a', 'gw_port_host': None}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 17:59:45.388995 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.415056 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Pushing event deleted for resources: {'Port': ['ID=9d95240a-ccfa-4ed4-9a44-c87e35b3805e,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:45.473007 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.561565 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.564001 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.612831 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.613285 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3aa8b869-37d4-425e-b171-c047e6dc9e96 {{(pid=108142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 17:59:45.618647 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.619820 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-36e66c0f-8e2d-45b6-a059-c0d9e3d94169 admin admin] 10.222.0.31 "DELETE /v2.0/routers/3aa8b869-37d4-425e-b171-c047e6dc9e96 HTTP/1.1" status: 204 len: 168 time: 0.7548635 Nov 15 17:59:45.622359 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34500) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:45.672012 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Deleting subnet f5225772-6a11-4da0-ae44-6f3385feeb4a {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 17:59:45.675463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.711162 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.798919 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.815559 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 33240b16-e01c-400d-9083-3e4dde7e2ccd no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:45.838931 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 33240b16-e01c-400d-9083-3e4dde7e2ccd {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:45.839266 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 33240b16-e01c-400d-9083-3e4dde7e2ccd not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:45.853569 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.880476 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f5225772-6a11-4da0-ae44-6f3385feeb4a,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:45.882539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:45.885618 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-efe73f49-20a8-4556-8899-7a3599721a95 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/f5225772-6a11-4da0-ae44-6f3385feeb4a HTTP/1.1" status: 204 len: 168 time: 0.2623010 Nov 15 17:59:45.886627 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-754769de-eabb-4fb5-bae2-740189553986 None None] Network 59245f04-b934-41a1-962b-b90d1d4fd2a7 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 17:59:45.888327 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34502) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:45.959752 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.012480 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Deleting port 5e18d761-908f-4ffd-b238-2bf479349d9c {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:46.012797 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.074456 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] For port 5e18d761-908f-4ffd-b238-2bf479349d9c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=5e18d761-908f-4ffd-b238-2bf479349d9c,segment=NetworkSegment(78968176-96ff-4a6a-916a-b46b0374f247),segment_id=78968176-96ff-4a6a-916a-b46b0374f247)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:46.074705 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.086911 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Calling delete_port for 5e18d761-908f-4ffd-b238-2bf479349d9c owned by network:dhcp {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:46.132376 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] DHCP port deletion for 59245f04-b934-41a1-962b-b90d1d4fd2a7 request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 17:59:46.172745 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.188989 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Deleting port 5e18d761-908f-4ffd-b238-2bf479349d9c {{(pid=108143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 17:59:46.189461 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.200129 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Pushing event deleted for resources: {'Port': ['ID=5e18d761-908f-4ffd-b238-2bf479349d9c,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:46.203947 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] No DVR routers for this DVR port 5e18d761-908f-4ffd-b238-2bf479349d9c on host dv-cinder-788366-7-iscsi {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:46.262093 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] For port 5e18d761-908f-4ffd-b238-2bf479349d9c, host dv-cinder-788366-7-iscsi, got binding levels [] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 17:59:46.262378 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.274876 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Calling delete_port for 5e18d761-908f-4ffd-b238-2bf479349d9c owned by network:dhcp {{(pid=108143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 17:59:46.277728 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.ipam_backend_mixin [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Port 5e18d761-908f-4ffd-b238-2bf479349d9c was not found and therefore no delete operation was performed {{(pid=108143) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 15 17:59:46.279060 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.279203 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527'] for port, after_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.299978 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['59245f04-b934-41a1-962b-b90d1d4fd2a7']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:46.307197 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] Pushing event deleted for resources: {'Port': ['ID=5e18d761-908f-4ffd-b238-2bf479349d9c,revision_number=None']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:46.310771 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93af0358-4cf8-444b-9a25-803d2bb5b33c None None] No DVR routers for this DVR port 5e18d761-908f-4ffd-b238-2bf479349d9c on host dv-cinder-788366-7-iscsi {{(pid=108143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 17:59:46.317225 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78968176-96ff-4a6a-916a-b46b0374f247') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:46.317770 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78968176-96ff-4a6a-916a-b46b0374f247') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 17:59:46.329868 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.343463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.349537 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Releasing vlan 425 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 17:59:46.349917 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 17:59:46.351575 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 17:59:46.407115 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.412486 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.415737 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] 10.222.0.31 "DELETE /v2.0/networks/59245f04-b934-41a1-962b-b90d1d4fd2a7 HTTP/1.1" status: 204 len: 168 time: 0.5264916 Nov 15 17:59:46.437174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f743f64-5ce4-4956-85b8-9b8dab29fcf7 admin admin] Pushing event deleted for resources: {'Network': ['ID=59245f04-b934-41a1-962b-b90d1d4fd2a7,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:46.534091 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34506) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:46.584805 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-89a78156-ea7a-4d09-a3c4-9e97c56e7c01 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=02ec9c6dcc7d48c5b52b4ee146d42ec8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0494940 Nov 15 17:59:46.587510 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34508) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:46.639594 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.666192 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.714293 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.717059 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:46.718338 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/147fbaa0-d208-48fa-8f36-ef1d41e3445f HTTP/1.1" status: 204 len: 168 time: 0.1293287 Nov 15 17:59:46.726537 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24a313c-b9a5-4ded-a576-6e66ff7bf7e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=147fbaa0-d208-48fa-8f36-ef1d41e3445f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:47.058304 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34514) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:47.098859 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-89dd35e6-4cb8-473d-b0df-d8f2a0e14809 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=103cb3e2cd054174b3c5891117ab586a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0393422 Nov 15 17:59:47.101518 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34516) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 17:59:47.154915 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:47.177032 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:47.230429 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:47.232999 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 17:59:47.234263 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f48dad76-d7fe-4469-9561-b0038da467c5 HTTP/1.1" status: 204 len: 168 time: 0.1317091 Nov 15 17:59:47.242358 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877876ed-338d-44cf-97cf-9099d1621e67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f48dad76-d7fe-4469-9561-b0038da467c5,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 17:59:47.705026 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5e18d761-908f-4ffd-b238-2bf479349d9c no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:47.726262 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 5e18d761-908f-4ffd-b238-2bf479349d9c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:47.726599 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 5e18d761-908f-4ffd-b238-2bf479349d9c not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:47.727000 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d95240a-ccfa-4ed4-9a44-c87e35b3805e no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 17:59:47.745752 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 9d95240a-ccfa-4ed4-9a44-c87e35b3805e {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 17:59:47.746086 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 9d95240a-ccfa-4ed4-9a44-c87e35b3805e not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 17:59:50.067926 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 17:59:52.462143 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:00.816562 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-07257a05-eced-4918-8731-ee5eb272393a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:03.130574 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b691c156-deaa-4f5b-97d7-02bf120f3aad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:04.506490 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:05.632926 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:06.688160 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:06.930105 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34522) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:07.090908 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Deleting port c3252657-2a44-46ed-b456-0dd1fa625844 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:07.091272 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.168367 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.168664 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.181305 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Calling delete_port for c3252657-2a44-46ed-b456-0dd1fa625844 owned by network:floatingip {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:07.337544 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.365346 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event deleted for resources: {'Port': ['ID=c3252657-2a44-46ed-b456-0dd1fa625844,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:07.377810 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.378153 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.378489 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.378819 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.379145 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.379463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.379814 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.380134 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.380451 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.380753 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.381069 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.381384 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:07.441191 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for floatingip, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.441426 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.db.l3_db [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Floating IP 901e012e-e439-4b8b-be78-8180527670cc disassociated (deleted). External IP: 172.27.0.184, port: 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55. Nov 15 18:00:07.644738 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Router 705e06c1-9692-44f5-9f70-49c868ee876e has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 18:00:07.753550 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 18:00:07.758320 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for floatingip, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:07.764544 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Sync routers for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 18:00:07.774743 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:07.776023 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:07.785398 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-9cb5521f-9f54-4a51-8c52-a1ae84972072 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "DELETE /v2.0/floatingips/901e012e-e439-4b8b-be78-8180527670cc HTTP/1.1" status: 204 len: 168 time: 0.8540339 Nov 15 18:00:07.786097 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 18:00:07.788367 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa6c1358-391d-4ca8-9a62-b1c53598a530" -d '{"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 18:00:07.829965 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 18:00:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7fa223c-e1ae-465b-9f87-5cc960b18f8d x-openstack-request-id: req-e7fa223c-e1ae-465b-9f87-5cc960b18f8d {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 18:00:07.830244 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 18:00:07.830513 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e7fa223c-e1ae-465b-9f87-5cc960b18f8d {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 18:00:07.830912 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'status': 'completed', 'code': 200} Nov 15 18:00:07.899871 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-4a1b687e-33eb-4d06-9381-0f2b476c729a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:07.901773 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-4a1b687e-33eb-4d06-9381-0f2b476c729a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=418a337f482c4773a787a5a90721966a&device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 1098 time: 0.0446537 Nov 15 18:00:08.020982 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-28aaee8b-a08f-4d29-87c3-b7ae30809945 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:08.022212 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:08.022547 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-28aaee8b-a08f-4d29-87c3-b7ae30809945 service neutron] 10.222.0.48 "GET /v2.0/networks?id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 200 len: 909 time: 0.1086137 Nov 15 18:00:08.027012 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d6e96d-d884-4185-a0a4-01f1918ec611 req-b32ea79a-6908-4901-a9f2-a7e04d26729d tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:08.028518 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-70d6e96d-d884-4185-a0a4-01f1918ec611 req-b32ea79a-6908-4901-a9f2-a7e04d26729d tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0533056 Nov 15 18:00:08.065564 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-aa94e129-21a0-4e2f-837e-7748e6f4fb13 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 200 len: 217 time: 0.0341852 Nov 15 18:00:08.079690 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-70d6e96d-d884-4185-a0a4-01f1918ec611 req-4757055c-7d5d-449f-9344-63a435457efb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450244 Nov 15 18:00:08.118192 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-006b03b7-10c5-4ebc-852a-5efef604643d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:08.119761 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-006b03b7-10c5-4ebc-852a-5efef604643d service neutron] 10.222.0.48 "GET /v2.0/subnets?id=908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 200 len: 847 time: 0.0441647 Nov 15 18:00:08.167711 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-323e8328-f181-48a5-8f00-d3931a99d09c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:08.169208 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-323e8328-f181-48a5-8f00-d3931a99d09c service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420513 Nov 15 18:00:08.216516 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:08.242648 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Checking router: 705e06c1-9692-44f5-9f70-49c868ee876e for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 18:00:08.252256 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:08.252865 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:08.256382 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-707d2a92-2d48-4c7f-b0ee-32e1ee8634a4 service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789373 Nov 15 18:00:08.353696 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-aa6c1358-391d-4ca8-9a62-b1c53598a530 req-4c75fb31-1497-4ddc-bc74-345c71a283eb service neutron] 10.222.0.48 "GET /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878661 Nov 15 18:00:08.362611 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:08.573276 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:08.607294 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe90ee4-ec82-4a8a-a61b-6a474b5e9e44 None None] The sync data for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi is: [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T17:55:49Z', 'revision_number': 4, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi', '_interfaces': [{'id': '82acd1b8-c9a5-4835-9110-2ba619a5e57c', 'name': '', 'network_id': 'ea8b085a-8c53-4bf9-a5ac-959d633cd3ec', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'mac_address': 'fa:16:3e:17:c4:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_interface', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': '908418a4-9235-410e-85b3-c01d93461c44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:48Z', 'updated_at': '2021-11-15T17:55:53Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'subnets': [{'id': '908418a4-9235-410e-85b3-c01d93461c44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 18:00:08.845832 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1b99be6-08af-435a-adc6-c7d75913e729 None None] New status for floating IP 901e012e-e439-4b8b-be78-8180527670cc: DOWN {{(pid=108144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 18:00:09.226592 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9844171-b310-4003-9fe3-0f1d245014ab req-92c7fd7a-4893-4749-b13c-f6ca212e2e2d tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:09.228589 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9844171-b310-4003-9fe3-0f1d245014ab req-92c7fd7a-4893-4749-b13c-f6ca212e2e2d tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0734825 Nov 15 18:00:09.288340 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-b9844171-b310-4003-9fe3-0f1d245014ab req-2bf207ba-37f4-4014-96e6-6495867a67eb tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/security-groups?id=4c4d31bc-10ad-4e45-b360-da275ad788a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492141 Nov 15 18:00:09.514764 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd209a5-f870-409c-9794-98066eeeef4b req-6660a212-0053-4412-b186-86e878c0280a tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 18:00:09.516239 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-efd209a5-f870-409c-9794-98066eeeef4b req-6660a212-0053-4412-b186-86e878c0280a tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.48 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 945 time: 0.0580387 Nov 15 18:00:09.619306 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Deleting port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:09.619546 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:09.714011 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] For port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55, host hv-cinder-78836, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78836',level=0,port_id=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:09.714368 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:09.726671 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Calling delete_port for 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 owned by compute:nova {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:10.131186 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:10.160877 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event deleted for resources: {'Port': ['ID=4fed676f-fdcc-4178-b3cb-58ba6e7e9f55,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:10.201698 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] No DVR routers for this DVR port 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 on host hv-cinder-78836 {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 18:00:10.204379 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-100498'] for port, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:10.207890 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [req-efd209a5-f870-409c-9794-98066eeeef4b req-6f19e790-3c29-48f6-b665-7b5f07f65e7e tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.48 "DELETE /v2.0/ports/4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 HTTP/1.1" status: 204 len: 173 time: 0.6850138 Nov 15 18:00:10.208282 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-deleted', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55'}] {{(pid=108142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 18:00:10.210541 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ea2e05774e4d08f1047b29ed1872236f0187b98a41ab5f5c5b3ba6e67db9909" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19876d1d-a990-499e-be5e-ad9a9580cdd1" -d '{"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-deleted", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55"}]}' {{(pid=108142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 18:00:10.248711 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 18:00:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b609cd8b-9262-425e-a6c1-3e5eb8de63ee x-openstack-request-id: req-b609cd8b-9262-425e-a6c1-3e5eb8de63ee {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 18:00:10.248994 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38410a59-5647-49e0-9673-d8b217fe01e8", "name": "network-vif-deleted", "tag": "4fed676f-fdcc-4178-b3cb-58ba6e7e9f55", "status": "completed", "code": 200}]} {{(pid=108142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 18:00:10.249239 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b609cd8b-9262-425e-a6c1-3e5eb8de63ee {{(pid=108142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 18:00:10.249625 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38410a59-5647-49e0-9673-d8b217fe01e8', 'name': 'network-vif-deleted', 'tag': '4fed676f-fdcc-4178-b3cb-58ba6e7e9f55', 'status': 'completed', 'code': 200} Nov 15 18:00:10.404330 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [req-d075fc70-384e-43ad-b1c9-8a77173cc2db req-b3b7e55e-d8b2-4766-8f8a-accc07309c29 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "GET /v2.0/ports?device_id=38410a59-5647-49e0-9673-d8b217fe01e8 HTTP/1.1" status: 200 len: 210 time: 0.0338631 Nov 15 18:00:11.478843 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34538) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:11.547491 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:11.574566 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:11.644623 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:11.647272 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:11.648452 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] 10.222.0.31 "DELETE /v2.0/security-groups/4c4d31bc-10ad-4e45-b360-da275ad788a7 HTTP/1.1" status: 204 len: 168 time: 0.1686516 Nov 15 18:00:11.658235 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ce0a85-7e92-4adc-8cc7-6093d3ce59e4 tempest-TestShelveInstance-1760519679 tempest-TestShelveInstance-1760519679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c4d31bc-10ad-4e45-b360-da275ad788a7,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:11.693669 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34542) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:12.044758 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:12.298966 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Deleting port 82acd1b8-c9a5-4835-9110-2ba619a5e57c {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:12.299209 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:12.381500 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] For port 82acd1b8-c9a5-4835-9110-2ba619a5e57c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=82acd1b8-c9a5-4835-9110-2ba619a5e57c,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:12.381851 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:12.394227 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Calling delete_port for 82acd1b8-c9a5-4835-9110-2ba619a5e57c owned by network:router_interface {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:12.435652 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 no longer exists at agent hyperv_hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:12.459544 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] No Port match for: 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:12.459901 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Device 4fed676f-fdcc-4178-b3cb-58ba6e7e9f55 not bound to the agent host hv-cinder-78836 {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:12.592811 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:12.627366 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Pushing event deleted for resources: {'Port': ['ID=82acd1b8-c9a5-4835-9110-2ba619a5e57c,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:12.790557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.011226 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Router 705e06c1-9692-44f5-9f70-49c868ee876e has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 18:00:13.118884 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 18:00:13.123907 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-81f0827a-b117-44c2-bf70-324d4c76887d admin admin] 10.222.0.31 "PUT /v2.0/routers/705e06c1-9692-44f5-9f70-49c868ee876e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4291484 Nov 15 18:00:13.126567 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34544) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:13.129255 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Sync routers for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 18:00:13.140550 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:13.141154 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:13.229603 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks [] for router, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.245436 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: dv-cinder-788366-7-iscsi {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:13.328171 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.380463 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Deleting port f952269a-2d08-495d-b368-70fcdc6d7b2f {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:13.380794 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.422239 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T18:00:12Z', 'revision_number': 5, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port': {'id': 'f952269a-2d08-495d-b368-70fcdc6d7b2f', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:ff:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:47Z', 'updated_at': '2021-11-15T17:55:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:13.448617 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Checking router: 705e06c1-9692-44f5-9f70-49c868ee876e for host: dv-cinder-788366-7-iscsi {{(pid=108143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 18:00:13.457408 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Routers {'705e06c1-9692-44f5-9f70-49c868ee876e'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:13.458016 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['705e06c1-9692-44f5-9f70-49c868ee876e'], 'active': True} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:13.463178 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] For port f952269a-2d08-495d-b368-70fcdc6d7b2f, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=f952269a-2d08-495d-b368-70fcdc6d7b2f,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:13.463539 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.476065 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Calling delete_port for f952269a-2d08-495d-b368-70fcdc6d7b2f owned by network:router_gateway {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:13.544217 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvr_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] Set router 705e06c1-9692-44f5-9f70-49c868ee876e gateway port host: None {{(pid=108143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:13.597660 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_hamode_db [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T18:00:13Z', 'revision_number': 6, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:13.624057 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ca2d41-0df8-44d1-8182-93aa2cc4a112 None None] The sync data for ids ['705e06c1-9692-44f5-9f70-49c868ee876e'] in dv-cinder-788366-7-iscsi is: [{'id': '705e06c1-9692-44f5-9f70-49c868ee876e', 'name': 'tempest-TestShelveInstance-711297402-router', 'tenant_id': '418a337f482c4773a787a5a90721966a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:46Z', 'updated_at': '2021-11-15T18:00:13Z', 'revision_number': 6, 'project_id': '418a337f482c4773a787a5a90721966a', 'gw_port_host': None}] {{(pid=108143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 18:00:13.636992 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.662974 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Pushing event deleted for resources: {'Port': ['ID=f952269a-2d08-495d-b368-70fcdc6d7b2f,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:13.721088 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.806930 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.809218 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.863477 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.864475 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 705e06c1-9692-44f5-9f70-49c868ee876e {{(pid=108142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 18:00:13.869815 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] Publish callbacks [] for router, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.871666 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-3faa8f8a-c76a-408b-98ab-55f062ec0692 admin admin] 10.222.0.31 "DELETE /v2.0/routers/705e06c1-9692-44f5-9f70-49c868ee876e HTTP/1.1" status: 204 len: 168 time: 0.7439930 Nov 15 18:00:13.875563 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34546) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:13.926157 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Deleting subnet 908418a4-9235-410e-85b3-c01d93461c44 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 18:00:13.930703 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:13.969902 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.064204 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.091094 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 82acd1b8-c9a5-4835-9110-2ba619a5e57c no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:14.120086 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 82acd1b8-c9a5-4835-9110-2ba619a5e57c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:14.120370 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 82acd1b8-c9a5-4835-9110-2ba619a5e57c not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:14.124889 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.147760 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=908418a4-9235-410e-85b3-c01d93461c44,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:14.153421 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.156825 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-4cc91a3f-01ec-48ef-b004-7c3e590dc822 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/908418a4-9235-410e-85b3-c01d93461c44 HTTP/1.1" status: 204 len: 168 time: 0.2797723 Nov 15 18:00:14.159153 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2480fdc1-9076-4eed-a047-c921c5f0cd45 None None] Network ea8b085a-8c53-4bf9-a5ac-959d633cd3ec requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 18:00:14.159290 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34548) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:14.228339 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.280810 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Deleting port 1b815aca-b900-454d-8ab9-02df678b9189 {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:14.281142 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.344467 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] For port 1b815aca-b900-454d-8ab9-02df678b9189, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=1b815aca-b900-454d-8ab9-02df678b9189,segment=NetworkSegment(d62f5f5e-b150-4fd9-8c65-68b3346d8ae0),segment_id=d62f5f5e-b150-4fd9-8c65-68b3346d8ae0)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:14.344784 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.357586 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Calling delete_port for 1b815aca-b900-454d-8ab9-02df678b9189 owned by network:dhcp {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:14.446276 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b39c7a05-e945-498d-8c84-36b0968c1b21 None None] DHCP port deletion for ea8b085a-8c53-4bf9-a5ac-959d633cd3ec request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 18:00:14.449972 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.480109 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] No DVR routers for this DVR port 1b815aca-b900-454d-8ab9-02df678b9189 on host dv-cinder-788366-7-iscsi {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 18:00:14.484083 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Pushing event deleted for resources: {'Port': ['ID=1b815aca-b900-454d-8ab9-02df678b9189,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:14.556364 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.576945 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea8b085a-8c53-4bf9-a5ac-959d633cd3ec']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:14.586354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:14.586713 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd62f5f5e-b150-4fd9-8c65-68b3346d8ae0') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:14.597740 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.613653 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.621930 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Releasing vlan 437 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 18:00:14.622343 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 18:00:14.624212 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 18:00:14.680772 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.686493 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:14.689871 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] 10.222.0.31 "DELETE /v2.0/networks/ea8b085a-8c53-4bf9-a5ac-959d633cd3ec HTTP/1.1" status: 204 len: 168 time: 0.5296602 Nov 15 18:00:14.692984 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34550) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:14.704954 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16afeaf4-4d74-4e15-ad9f-94a54432a4ee admin admin] Pushing event deleted for resources: {'Network': ['ID=ea8b085a-8c53-4bf9-a5ac-959d633cd3ec,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:15.292349 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3755185'] for router_interface, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:15.541365 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Deleting port b961a051-c737-4748-bb22-9c4491891c5c {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:15.541675 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:15.622450 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] For port b961a051-c737-4748-bb22-9c4491891c5c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=b961a051-c737-4748-bb22-9c4491891c5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:15.622694 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:15.634699 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Calling delete_port for b961a051-c737-4748-bb22-9c4491891c5c owned by network:router_interface {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:15.727269 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 1b815aca-b900-454d-8ab9-02df678b9189 no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:15.748321 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 1b815aca-b900-454d-8ab9-02df678b9189 {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:15.748661 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 1b815aca-b900-454d-8ab9-02df678b9189 not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:15.749075 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device f952269a-2d08-495d-b368-70fcdc6d7b2f no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:15.767505 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: f952269a-2d08-495d-b368-70fcdc6d7b2f {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:15.767875 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device f952269a-2d08-495d-b368-70fcdc6d7b2f not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:15.820347 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:15.853341 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Pushing event deleted for resources: {'Port': ['ID=b961a051-c737-4748-bb22-9c4491891c5c,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:15.875138 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.875387 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.875730 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.876064 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.876366 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.876703 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.877023 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.877344 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.877665 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.877966 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.878768 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:15.878768 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-788366-7-iscsi {{(pid=108141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 18:00:16.020385 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3731261', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3755205'] for router_interface, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.256554 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Router 60b02c33-2600-4471-baf3-761be4616c65 has already been hosted by L3 agent e15e176f-d23a-48d0-b307-b4e86dc3a39d {{(pid=108141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 18:00:16.368976 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] Notify agent at l3_agent.dv-cinder-788366-7-iscsi the message routers_updated {{(pid=108141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 18:00:16.374249 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-6447bfd1-0239-4dac-b0b7-d2504315e39d admin admin] 10.222.0.31 "PUT /v2.0/routers/60b02c33-2600-4471-baf3-761be4616c65/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6802177 Nov 15 18:00:16.376786 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34552) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:16.377555 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Sync routers for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 18:00:16.388123 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:16.388804 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:16.478871 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks [] for router, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.495175 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: dv-cinder-788366-7-iscsi {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:16.578946 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.632925 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Deleting port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb {{(pid=108141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:16.633235 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.670267 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'external_fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231'}], 'enable_snat': True}, 'gw_port_id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T18:00:15Z', 'revision_number': 5, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port': {'id': '0df2c911-d7e8-49a5-a5a2-a6a29c05fccb', 'name': '', 'network_id': '5536583f-f2fb-4579-9b55-62f8818c8ea0', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:49:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60b02c33-2600-4471-baf3-761be4616c65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'ip_address': '172.27.0.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-788366-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T17:55:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd734db9-2a5e-4bf6-98ea-2ce68d800b8c', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-788366-7-iscsi'}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:16.699653 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Checking router: 60b02c33-2600-4471-baf3-761be4616c65 for host: dv-cinder-788366-7-iscsi {{(pid=108144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 18:00:16.707977 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Routers {'60b02c33-2600-4471-baf3-761be4616c65'} bound to L3 agent in host dv-cinder-788366-7-iscsi {{(pid=108144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 18:00:16.708569 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-788366-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T17:40:03Z,description=,heartbeat_timestamp=2021-11-15T18:00:03Z,host='dv-cinder-788366-7-iscsi',id=e15e176f-d23a-48d0-b307-b4e86dc3a39d,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T17:40:03Z,topic='l3_agent')) {'router_ids': ['60b02c33-2600-4471-baf3-761be4616c65'], 'active': True} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:16.721263 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.db [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] For port 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,segment=NetworkSegment(c49a3786-2afe-45a0-abea-ecf0c6157177),segment_id=c49a3786-2afe-45a0-abea-ecf0c6157177)] {{(pid=108141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:16.721613 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.733521 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.plugins.ml2.plugin [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Calling delete_port for 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb owned by network:router_gateway {{(pid=108141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:16.792996 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_dvr_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] Set router 60b02c33-2600-4471-baf3-761be4616c65 gateway port host: None {{(pid=108144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 18:00:16.842945 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.l3_hamode_db [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T18:00:16Z', 'revision_number': 6, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port_host': None}], 'dv-cinder-788366-7-iscsi', False) {} {{(pid=108144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:16.873139 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53153430-495e-4d1d-869c-fe1aba8e0883 None None] The sync data for ids ['60b02c33-2600-4471-baf3-761be4616c65'] in dv-cinder-788366-7-iscsi is: [{'id': '60b02c33-2600-4471-baf3-761be4616c65', 'name': 'tempest-TestShelveInstance-1169451319-router', 'tenant_id': '99fca80b5c8548b0a4717185841f27b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T17:55:51Z', 'updated_at': '2021-11-15T18:00:16Z', 'revision_number': 6, 'project_id': '99fca80b5c8548b0a4717185841f27b3', 'gw_port_host': None}] {{(pid=108144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 18:00:16.899872 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59170154'] for port, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:16.926571 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Pushing event deleted for resources: {'Port': ['ID=0df2c911-d7e8-49a5-a5a2-a6a29c05fccb,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:16.988644 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3753855'] for router_gateway, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.076901 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3764637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-744'] for router, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.079155 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.127171 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3764612'] for router, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.127683 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 60b02c33-2600-4471-baf3-761be4616c65 {{(pid=108141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 18:00:17.132108 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] Publish callbacks [] for router, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.133253 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-69c6cbf9-8302-4c78-b19d-7e393ac93c3f admin admin] 10.222.0.31 "DELETE /v2.0/routers/60b02c33-2600-4471-baf3-761be4616c65 HTTP/1.1" status: 204 len: 168 time: 0.7555587 Nov 15 18:00:17.136027 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34554) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:17.184354 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.db_base_plugin_v2 [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Deleting subnet dc325d00-5dbf-4c73-865a-c2ec647b9645 {{(pid=108142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 18:00:17.188191 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.235491 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-59201532'] for subnet, precommit_delete_associations {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.315732 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-671959'] for subnet, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.371292 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-671966', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3795859', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-59364648', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-58888458'] for subnet, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.397799 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dc325d00-5dbf-4c73-865a-c2ec647b9645,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:17.403930 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] Publish callbacks [] for subnet, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.409460 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-c8011838-3a12-4c9b-b9bb-21a38107d44d admin admin] 10.222.0.31 "DELETE /v2.0/subnets/dc325d00-5dbf-4c73-865a-c2ec647b9645 HTTP/1.1" status: 204 len: 168 time: 0.2700231 Nov 15 18:00:17.409627 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98763da3-6724-43ea-805c-98f9f36eac20 None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 requested from dv-cinder-788366-7-iscsi {{(pid=108143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 18:00:17.410120 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34556) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:17.475769 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3428752'] for network, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.529265 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Deleting port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c {{(pid=108142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:17.529601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.604275 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.db [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] For port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:17.604611 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.618557 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.plugin [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Calling delete_port for 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c owned by network:dhcp {{(pid=108142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:17.626236 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] DHCP port deletion for 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 request from dv-cinder-788366-7-iscsi {{(pid=108143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 18:00:17.681447 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Deleting port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c {{(pid=108143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 18:00:17.681819 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762238761683'] for port, before_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.703629 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-59364805'] for port, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.738817 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Pushing event deleted for resources: {'Port': ['ID=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:17.741174 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] No DVR routers for this DVR port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c on host dv-cinder-788366-7-iscsi {{(pid=108142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 18:00:17.749069 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:17.783646 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:17.784010 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0df2c911-d7e8-49a5-a5a2-a6a29c05fccb not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:17.784423 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:17.808794 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:17.809129 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:17.809543 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b961a051-c737-4748-bb22-9c4491891c5c no longer exists at agent ovs-agent-dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 18:00:17.811292 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-674382', 'neutron.services.segments.db._delete_segments_for_network-8762238920906'] for network, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.831362 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['385ed69e-2c30-483e-bdd6-a8942b0fe2d0']}} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:17.837296 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.db [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] For port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c, host dv-cinder-788366-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-788366-7-iscsi',level=0,port_id=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,segment=NetworkSegment(dcb016f8-fafb-4b53-ab1d-6042fadd5d07),segment_id=dcb016f8-fafb-4b53-ab1d-6042fadd5d07)] {{(pid=108143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 18:00:17.837692 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3757291'] for port, precommit_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.842618 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07') {'for_net_delete': True} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:17.842925 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.services.segments.db [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dcb016f8-fafb-4b53-ab1d-6042fadd5d07') {} {{(pid=108142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 18:00:17.845123 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] No Port match for: b961a051-c737-4748-bb22-9c4491891c5c {{(pid=108143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 18:00:17.845465 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.rpc [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Device b961a051-c737-4748-bb22-9c4491891c5c not bound to the agent host dv-cinder-788366-7-iscsi {{(pid=108143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 18:00:17.854574 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762238926547', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-59201477'] for segment, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.855774 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.plugins.ml2.plugin [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Calling delete_port for 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c owned by network:dhcp {{(pid=108143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 18:00:17.873818 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422'] for segment, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.881428 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Releasing vlan 442 on physical network physnet1 to pool {{(pid=108142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 18:00:17.881872 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-678422', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-59364754'] for segment, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: Traceback (most recent call last): Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: timer() Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: cb(*args, **kw) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: return func(*args, **kwargs) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: self._notify() Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: self.callback(batched_events) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: event.method(event) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: return f(self, *a, **k) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._get(url).json() Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: return self.request(url, 'GET', **kwargs) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 18:00:17.883673 dv-cinder-788366-7-iscsi neutron-server[108142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 18:00:17.943044 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-670920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-146145', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762238850205', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762238340527'] for port, after_delete {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.946017 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-674389', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771072', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3731206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3753819'] for network, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.952495 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3731224'] for network, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:17.958045 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] 10.222.0.31 "DELETE /v2.0/networks/385ed69e-2c30-483e-bdd6-a8942b0fe2d0 HTTP/1.1" status: 204 len: 168 time: 0.5450866 Nov 15 18:00:17.968961 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5067ddec-59a9-4107-bc14-2af3aa915111 admin admin] Pushing event deleted for resources: {'Network': ['ID=385ed69e-2c30-483e-bdd6-a8942b0fe2d0,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:17.972502 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Network 385ed69e-2c30-483e-bdd6-a8942b0fe2d0 is not hosted by any dhcp agent {{(pid=108143) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 15 18:00:17.972960 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] No DVR routers for this DVR port 0ecc245e-a080-4f1a-ae90-6eec3b13cf5c on host dv-cinder-788366-7-iscsi {{(pid=108143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 18:00:17.977845 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f313a054-c713-4fec-b143-12dfa630e6b0 None None] Pushing event deleted for resources: {'Port': ['ID=0ecc245e-a080-4f1a-ae90-6eec3b13cf5c,revision_number=None']} {{(pid=108143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:18.143016 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34560) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:18.184881 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-8568e7c4-dfac-47be-9287-daf9924ff962 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=418a337f482c4773a787a5a90721966a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0405493 Nov 15 18:00:18.187412 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [-] (108141) accepted ('10.222.0.31', 34562) {{(pid=108141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:18.238112 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.259309 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.308107 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.312130 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron_lib.callbacks.manager [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.313464 dv-cinder-788366-7-iscsi neutron-server[108141]: INFO neutron.wsgi [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/df99a6de-2c28-4a0b-b2b8-75a77c85fc4e HTTP/1.1" status: 204 len: 168 time: 0.1250074 Nov 15 18:00:18.322232 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8698747a-8807-46cb-9e11-610f2cc5b4f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df99a6de-2c28-4a0b-b2b8-75a77c85fc4e,revision_number=None']} {{(pid=108141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:18.639936 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34568) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:18.686710 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-b656ca3a-621b-4408-ae60-5ff547952333 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=99fca80b5c8548b0a4717185841f27b3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0456109 Nov 15 18:00:18.689407 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.wsgi [-] (108142) accepted ('10.222.0.31', 34570) {{(pid=108142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 18:00:18.738457 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.764167 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.823347 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3771007'] for security_group, after_delete {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.827601 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron_lib.callbacks.manager [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:18.829240 dv-cinder-788366-7-iscsi neutron-server[108142]: INFO neutron.wsgi [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cad08d99-ee45-44ba-9bdc-697031e1f170 HTTP/1.1" status: 204 len: 168 time: 0.1389527 Nov 15 18:00:18.837326 dv-cinder-788366-7-iscsi neutron-server[108142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e681e8-be99-45e4-b228-d40aa458eb8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cad08d99-ee45-44ba-9bdc-697031e1f170,revision_number=None']} {{(pid=108142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 18:00:22.462636 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:27.075060 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:00:30.815587 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-368c437f-d5d6-4313-9cae-51db7ae9a688 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:33.139854 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-46eba806-843e-4153-80c5-1f1b3a1d4d27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:34.506040 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:35.634644 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:36.676436 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:00:52.470227 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:00.814800 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-1645c5bb-54d0-4375-ba44-9171bfaadb86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:03.136742 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-47f7d68b-bc6b-4a54-bd41-e4def28b4d50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:04.068348 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:01:04.508002 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:05.637082 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:06.673163 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:22.492125 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:30.808702 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c70c90d4-46d9-4ccb-b951-bff3d3ab259b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:33.128655 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-6cbfd283-4641-41e2-867b-3866679a3d62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:34.514950 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:35.643978 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:36.670316 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:01:41.071597 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:01:52.496595 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:00.815249 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d5f1d208-cb74-4b27-b2c2-6660b5ae56a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:03.128347 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-ec55412d-3160-432d-bc1f-d735a263f348 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:04.523446 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:05.645606 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:06.676715 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:18.071326 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:02:22.498599 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:30.809600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-181b4e83-cbf0-445b-8b48-4c6d3e2f0036 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:33.122403 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-40e15a56-90f8-48db-bd90-db2296775ee6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:34.520534 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:35.642178 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:36.663044 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:52.515024 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:02:55.072377 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:03:00.812397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-09ac688b-ed40-4317-9edc-0c846ade94ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:03.127420 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-81336fd8-4419-4e7c-a974-46799c01197a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:04.520782 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:05.645454 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:06.662445 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:22.527549 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:30.818787 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-f45edf5a-1803-4272-ad48-998617a77e90 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:32.074383 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:03:33.122625 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-d4aff645-d393-457c-869b-2a1ea1ee5a24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:34.529958 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:35.655397 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:36.667494 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:03:38.179554 dv-cinder-788366-7-iscsi neutron-server[108141]: DEBUG neutron.wsgi [req-01076191-7790-4984-957a-1b043c52d4a7 req-da1354d5-45c8-4114-bf95-01b841c6af25 service neutron] (108141) timed out ('10.222.0.48', 53979) {{(pid=108141) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 15 18:03:52.537375 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:00.829625 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-3137d55d-c829-4335-acfe-32d6cd212c68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:03.131600 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-9d23cf8f-40da-4883-9426-b6e992f699ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:04.531799 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:05.656723 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:06.669362 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:09.076693 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:04:22.547281 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:30.825969 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-61996614-3388-4837-aedf-42399431d262 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:33.129019 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-7451848c-a274-4e64-94c3-309430d2fa77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:34.535758 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:35.660283 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:36.666665 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:04:46.077125 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:04:52.542168 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:00.835721 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-c1db34e9-9a18-4337-a3ad-2e6a85ca78b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:03.123940 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4cb14b52-0d3c-4fac-9a16-5fc08cfaf362 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:04.532784 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-78998ab7-b815-4a78-8ce0-a2292240432f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:05.663470 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c7a8d05-1565-4b72-ac81-2547ba777e6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:06.663248 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-b2057741-c6e2-4359-9737-e1a9de0021e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:22.536140 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-e86ddcc7-f600-48ff-9d20-b90adc0cc72a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 18:05:23.079269 dv-cinder-788366-7-iscsi neutron-server[108144]: DEBUG neutron.db.agents_db [None req-2f60a394-3d60-4a39-8dcb-cd291a5299d0 None None] Agent healthcheck: found 6 active agents {{(pid=108144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 18:05:30.831351 dv-cinder-788366-7-iscsi neutron-server[108143]: DEBUG neutron_lib.callbacks.manager [None req-4c4c51cc-d948-41f4-bd30-85b28ab15caf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762238920888', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-684176'] for agent, after_update {{(pid=108143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}